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ABSTRACT 

The 1987 Association for Institutional Research 
annual forum theme, '^Managing Education Better,** is covered by 
keynote and general sessions speakers from four angles: (1) how to 
study the student, (2) effects of different presidential styles, (3) 
the changing role of information technology , and (4) evaluating the 
effectiveness of our processes. After an introduction by Gerald W. 
McLaughlin, the forum chair, the following papers are presented: 
"Managing Education Better: Some Thoughts on the Management of 
Student Culture in American Colleges and Universities** (John Van 
Maanen); ''Executive Leadership: The Pros and the Cons** (Brunetca Reid 
Wolfman and Burton I. Molfman); **Inf orroation Technology: Using It in 
Relevant Ways** (Christine V. Bullen); and ** Assessment , Accreditation, 
and Institutional Effectiveness: Implications for Our Profession** 
(Donald J. Reichard and Theodore J. Marchese). References are 
included with each paper. (SM) 
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INTRODUCTION 



The Twenty-Seventh Annual Forum of the Association for Institutional 
Research provided professional development and networking 
opportunities that were both rich and varied. 

General session speakers approached tiif^ conference theme, 
"'Managing Education Better, ''from four angles. They discussed: 1) how 
to study the unique element of our enterprise, the student; 2) the effects 
of different presidential styles; 3) the changing role of information 
technology, and 4) evaluating the effectiveness of our processes. In- 
dividual presentations, workshops, practica, and seminars helped 
develop the professional skills we use to support decision-making in 
higher education. These presentations were structured into seven func- 
tional areas within which our responsibilities are found, 

Thi^ use of functional tracks, continued from the Orlando Forum, was 
helpful in establishing groups within which individuals could meet 
others with similar concerns. Special Interest Groups based on content, 
institution type, and region also supported networking, as did expanded 
use of table topics, newcomers' sessions, and special events. 

If yon were in KC, Ihopeyor enjoyed the conference. If you were unable 
to attend, I trust that the following materials from the Forum will be 
beneficial to you. 

I also hope that we will all get to Arizona where the Forum will focus us 
on "Promoting Quality Through Leader:^hip. " In addition to attending, 
please share your insights and concerns. The real strength of our 
Association is your participation. 




Gerald W. McLaughlin 
Foium Chair 
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MANAGING EDUCATION BETTER: SOME THOUGHTS 
ON THE MANAGEMENT OF STUDENT CULTURE 
IN AMERICAN COLLEGES AND UNIVERSITIES 

(keynote address) 

John Van Maanen, Professor 
Sloan School of Management 
Massachusettes Institute of Technology 

(This is an edited record of an address presented in he Count Basie BaUro&n of 
the Vista International Hotel, in Kansas City, Missour., on Sunday evening. Nay 
3, 1987.) 

All desperados of the podiun know that justifying one*s 
presence on a public platform is a tricky matter. One's words 
must be sufficiently authoritative tD carry weight, but not 
carry so much weight as to sink the Hhole enterprise. More 
importantly, a keynote speaker is under some obligation to show 
that he shares with his audience proper respect for tht^ topics 
to be considered in our case, colleges and universities arJ 
the natives within them. On this score I can say that, like 
most of you, I find college life rich, varied, oxciting and 
worthy. In fact, I so enjoyed college as a student that I 
managed to attend six of them, and as a faculty menber I have 
almost equalled that count by obtaining visitation rights. I 
regard the campus as a warmer and better place to be than the grim corridors of 
IBM, US Steel, or General Motors and far better than being trapped on the DC 
shuttle in behalf of a governmental agency. I SMppose Pve come to appreciate 
university life so t^oroughly that I am constitutionally unfit for any other 
employment. While I will have some sharp conments to make «bout the organiza- 
tions of our r!utual association, I make them with a deep and abiding concern and 
Interest in their welfare. 

Colleges and universities in any society and this one fn particular ■- take on 
goals that carry enormous nmbition and conceit. They have, as many have sug- 
gested, an impossible mandate. To offer up a coninon one: Higher education is to 
"fulfill and transform" students, to nake them smarter, wiser, more skilled and 
competent in matters of value to the society as well more "concerned, enlightened 
and complete** human beings. If this vision is shared, as I think it is, the 
means to its achievement are ranarkably varied. As Paul Fussell (1983, p. 135) 
suggests, our current situation is not so very di f ferent from what it was in the 
18708, when umaturally proud citizens could exult: "There are two universities 
in England, four in France, ten in Prussia, and thirty- seven in Ohio." 

He now have some 12 to U million students in some 3,000 to 4,000 two-year and 
four-year inntitutions. There are the Lutheran colleges of Lake Wobegone, the 
urban Catholic universities, the elite Ivies, the seven sisters, military 
academies, women's colleges, black colleges, conm^ity colleges, open-door 
colleges, technical and agricultural colleges, walled- in colleges and colleges 
without walls, colleges offering hardy vocational programs in business or 
engineering, and colleges •- limping along these day -- promoting cultural 
capital in ancient Greek or modem philosophy. There are also colleges built 
around monunsntal football stadiuns with trophy case shrines and those built 
around prayer towers or cyclotrons. Each has a unique history, set of tradi* 
tions, and special sense of worth. 
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It is clear that associated with this situation is a good deal of national pride, 
vested largely in the . jribers of students we manage to punp into and out of these 
fnstitutions each year. We are probably the only nation that displays such pride 
in public by the decals we place on our family cars. So sacred is college that 
not to put State U or Apache Creek Connunity College on display when our associa- 
tion warrants it is something of a sacrilege. 

The basis of such pride and honor seems many times to be somewhat misplaced, 
having little to do with the quality of college in the sense of to "fulfill and 
transform.** It rests too often on that good old American practice that Veblen 
labelled **invidious display/* the art of being one up on one's neighbor, it 
stems also from rivalry among colleges for the loyalties and affections of the 
citizenry. Such status-mongering reflects, however, some hard economic facts 
itfiereby some institutions swell and others shrink on the basis of their repute* 
tfons. rrom this perspective, it is not surprising that making the Sweet Sixteen 
or the annual NCAA basketball tournament does far more for the resource base of a 
college than placing 16 graduates at oxford as Rhodes Scholars. 

A good deal of our talk about colleges and universities rests on culturally 
specific, economically constrained and emotionally laden facts, for it is by no 
means clear what constitutes the **good college.** The criteria are multiple, 
particularistic, emergent and, when the chips are down, conflictual. In this 
context, consider what seems to be a growing national hysteria about what many 
take to be a general decline in the educational quality of American institutions. 
Much of this worry is directed at the elementary and secondary schools, but 
certainly some of it is reserved for colleges and universities. Even the most 
honored are not spared criticism. 

Current concerns are indexed by the formation of national panels to address 
eAJcational problems. State legislatures call for the testir^ of our college 
grads to assure their constituents that our baccalaureate programs are producing 
the educeted widgets we claim. New presidents and deans are installed in our 
universities explicitly to recharge educational batteries. Faculty and adninis- 
trators convene acrocs the land to ponder once again what kinds of distribution 
requirements, enriched majors, standardized programs or core curricula are needed 
to meet the **new** challenges posed by technology, science, language or society. 
The recent unrest and high anxiety Sv^ems to have little to do with students or 
university life per se; it reflects instead a kind of face-iaving nationalism (or 
chauvinism) reminiscent of the years following the Russian success with Sputnik. 
Our cur'-icular marines are now being called out to fix things up and restore our 
national pride and competitiveness. Predictably, the call is for mear^rable 
outputs, no*nonsense leadership, better inputs, tightened-up requirements, 
remedial programs, doing away with the slack so we can become lean and mean 
again, more accoititability, streamlined course offerings, better instruction or, 
put more crudely, **more bari^i for the buck.** 

Unfortiruitely, in this presumed ratcheting-up of our educational plans and 
plants, precious little attention seems to be given to the natives* point of view 
the natives being our beleaguered and belabored undergraduate students. To 
understand the native requires a good deal more than testing. It requires us to 
pause for a moment and consider the possibility that cultural matters may well be 
the integral, dynamic and primary determinants of students* performance, more 
important than the market economy and the wish for social mobility. 

With that in mind, what can we say about student culture? Ue can begin b/ saying 
something of its character. I once asked an MIT student of mine to provide a 
definition for the Institute*s culture. Without batting an eye, she responded by 
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saying: "It's everything ne aren't tested on in the classroom," However little 
this nay be at MIT, it's a damn good answer. Student culture consists of the 
taken- for -granted patterns of eating, sleeping, socializir^; the embraced and 
disgraced habits of stud/; the rules of thunb about what activities on campus 
count as status -enhancing or status-degrading; the norms surrouxJing what is 
proper demeanor in and out of the classroom; the loose consensus among students 
as to which classes are "gut" and which are not; the grapevine gossip that tells 
students which teachers to take and which to avoid, and so forth. Student 
cultures offer their members thick and thin guidelines for how to get an educa* 
tion, and thus define for students just what an education means. They vary 
within and between campuses but, rest assured, they are present. 

They are present largely because we, as agents or managers of student lives, 
bring together large nurvbers of iike-minoed people at one time, in one place, 
there to be "batch -processed" through a lengthy sequence marked by specific 
.problems that are best solved collectively rather than individually. The 
functional utility of student cultures is irost clf'*'*ly seen in the nunerous 
studies of student failure. Such studies demonstrate over and over that those 
students least likely to graduate oc otherwise do well in school are those with 
the fewest social ties to fellow students. "Fitting in" is as important to 
success in college as it is anywhere else in the world. 

The hard questions we must ask, then, do not question the existence of student 
cultures, but rather concern their vitality, orientation and the lessons students 
learn as a natural consequence of their membership. Are they supportive of our 
edjcational ideals? Are they disruptive? More importantly, perhaps, are they 
open and caring, respectful of others, and embracing of values that foster growth 
and maturity? Or are they closed, exciusionary enclaves of homogeneity, cynical 
of societal values and concerned only with "making out" in college and beyond? 
Are they, as Time Magazine might put it, "self-policed bastions of stifling 
conformity and the me- first ethic?" 

Needless to say, there aren't categorical answers to questions such as these. 
M)at i2 categorical is the extent to which college adninistrators and faculty set 
the tone for these cultures and, consciously or uKonsciousiy, ma'^iage them 
through a vast nunber of big and little decisions that quietly direct student 
life. The message I bring is that student cultures produce failures of a 
collective sort -- as seems apparent when libraries go unused, soft, unchal- 
lenging course loads become the favored means to a degree, sullen, silent 
students sit listlessly through classes, scholarly traditions go by the wayside, 
or self'indjlgent rites of spring e .tend from September through Ju>e. It makes 
as little sense to fault the students or their backgromds for such matters as it 
does to blame victims for the rise of urban crime. 

Let me illustrate what I mean by providing a few brief sketches of some problem- 
atic areas of student life. These are domains that I think vitaily inportant, 
but they are woefully neglected in our research and discourse on college and 
universities. There is some bias here, since these are areas with which I have 
some personal experience, but they do illustrate well 0.e kinds of proulems 
student cultures seem to organize around. If we are ever to manage education 
better, it is clear that we must learn to address questions such as these. 

Consider, first, what happens to students during their pre- enrol Iment days when 

they are prospective freshman, i e. highly-valued *'game" in these days of 

scarcity, retrenchment and declining enrollments. Sociologists regard this 

period as an initiatory phase of cultural learning and note its marked impact on 
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each arKi every recruit. Uhat do we do to students before they pass through our 
hallowad gates? 



In a word, we *TU8h** them. Fairs, telephone campaigns, mass maiUngs, pam- 
phleteering, aluml contacts and, somewhat ei^shemlstically, **selectlon Inter* 
views," are a few of the forms the rush takes. The content of these events and 
materials can be glimpsed in the ubiquitous recruiting brochure. Those I*ve 
looked at suggest that virtually all college classes are held outside, on warm, 
sunny days, next to large bodies of water, presided ovrr by casual lyatti red (but 
serious) white males of rugged (but youthful) appearance who sit surrounded by 
adoring students in the shade of a spreading elm. Prospective students who 
actually show up on canpus for the much recomnended "personal visit" seem to do a 
Httle better than brochure readers but not much. I recently witnessed a 
campus tour that included steps at the underground mini -mall on campus, the 
student union, the aluml pool, a student pub, a large-screen TV salon and the 
i&teps, but not the interior, of the library, lecture halls and faculty office 
buildings. The tour ended next to a Nr. Honey instant cash machine located in 
the lobby of a towering student donii. 

The distinct impression one gets from such a rush is that education itself 
doesn't sell very welt. We display precious little interest in letting students 
in on the arcane secrets of just who teaches what to freshmen and just whan and 
where such instruction might take place, "Market share^ Is apparently the 
bottom-line; and if w> squirm a little at such a vulgar characterization, let's 
all squirm some more by considering an aJ for a university acknlssions director 
that appraixl recently in The Wew York Time s Education Section. It asked for 
resunra /rom those with a "good speaking voice, telephone skills, and the Ability 
to close." (quoted in Boyer, 1987, p. 22). 

The fact of the matter is that more and more colleges, public and private, are 
enrollment- or tuition-driven enterprises engaged in a fierce survival game. A 
recent Carnegie Commission report on higher education suggests that fewer than 50 
fojr-year colleges and universities can be considered selective under the moat 
generoua criteria: accepting fewer than half of those who apply. The average 
acceptance rate in four-year institutions is three out of four, and about 35 
percent of our institutions are virtually open-door. Little wonder "ma'-ket 
share*' and other jargon of tl e biz school have penetrated the adnissions office 
of Shad/ U. 

kiat does all this mean to potential recruits? Confusion, of course, since a 
babble of claims of what Shady U or Beachfront Tech can do for John or Hary fills 
the air. The order of the day seems to be inflated expectations as '-o what 
college offers and a general lack of reaMsm about what is required of students. 
Not all of this confusion results from our recruiting practices; some of it can 
be traced to the growing gap between secondary and post -secondary education. The 
upshot of all this is that our high-choice system for sel^ting a college and 
starting college life is fairly chaotic* frantic and personalized. 

Such a context sets up the "reality shock" of the initiatory period of college 
careers. As it occurs in many schools, a more poorly-managed process fs diffi- 
cult to imagine. Too often, our student newcomers receive the residuals of 
whatever strengths an institution has to offer. Undergraduate, lower-divisior. 
courses are characterized by their large size, their stiff lecture and recitation 
format, their standardized materials, their general lack of excitement, and their 
impersonal evaluation procedures. Typically they are taught by low-status, 
inexperienced faculty as distressed by the classroom situation as the students. 
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Thfs seems true across the mix of institutions, notwithstanding a few well- 
publicized exceptions that essentially prove the rule. 

Placed against the high expectations generated b/ selection practices, the 
reality shock for many is devastating. Turnover statistics bear this out. One 
of the more distinctive features of the Americar. system of higher education, 
coopared to other systems, is the restlessness and apparent dissatisfaction 
expressed by students whose academic careers may touch more than one school. 
(This is said by one whose Bachelor of ^ ts degree wes earned at five different 
colleges!) 

Particularly poignant examples of our failure to treat seriously the old adage 
about first impressions being lasting are seen during the initial few weeks of 
canpus life for cannon-denominator freshmen. Few students report any sense of 
being indicted into or enbraced by a special community. Orientation program 
seem to be catch-as-catch-can, voluntary affairs that pay little heed to the tact 
that the first few weeks on campus are critically itiportant in terms of estab- 
lishing daily routines, setting study patterns, developing local friendships and 
forming attitudes about college life. Given that about 30 percent of all our 
students are now pert-time and more than twice that percentage commute, this 
failure to menage well the take-off stage of college life is particularly 
disturbing. 

Consider, also, life-after-entry and the routinization and down-to-earth details 
of student life. There are 168 hours in the week. If a suident attends class an 
average of 15 of those hours and studies, charitably, two hours for each hour in 
class, 45 hours in total are given over to academics. Take another 50 hours out 
for sleeping and eating and we are left with 70 hours unaccounted for by the 
basics of college. How do students make use of this time? Most, it seems, work. 
Yet, we are very unlikely to have much data on just who, where, how and what 
students do liien they work, let alone information about how their work affects 
perfonnance in the classroom. If th*;re is a link between education and work, it 
is a tenuous one established more on the basis of myth and folklore than on any 
direct evidence- Indirect evidence is not reassuring. Harper's Index , for 
example, informs us that one of every 15 Americans now working has wcrked at 
NcDonald*s, the sort of workplace where employees are eligible for a bonus if 
they manaye to last a month on the job. What lessons and what values are 
transmitted in the youth labor markets of today? 

Closer to home, today's college students show a marked preference for living on 
canpus. Residential students appnrently prefer the convenience, economy and 
social scene of canpus life if, at some college, they are lucky enoiQh to find 
space and i^t be warehoused in local hottls and motels. Yet, there seems to be 
widespread ambivalence among college administrators as^ to just what responsibil- 
ities they should take toward student life and behavior. Residence hall manage- 
ment is too often abd'cated by administrators who know what is happening only 
liien such activity threatens to bring unwanted outside attention. In charge are 
student personnel officials who, in curn, delegate day-to-day management to 
Resident Assistants. As an ex-RA, I attest to the 24-hour-a-day character of a 
vastly ifxierrated, underpaid and difficult job finding ligh'. bulbs at four 
a.m, birth-control counseling, cleaning up vomit ii« the lounge, settling family- 
likr disputes in the co-ed dorm. RAs typically are only a few years the senior 
of their charges but, in many respects, they are the life-blood o* the residen- 
tial college. They are the priests and police who keep students attending to 
their studies, to their work, to their friends and, in extreme cases, to their 
lives. I daresay, however, that few college professors, deans, institutional 
researchers or presidents could identify a single RA on their canpus by name. 
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I do not wish to bypass other variations of student life outside the classroom. 
The Greek system is beck with us again, and agoin there is evidence of its smug, 
standoffish, selfish character a concern even if only three percent of all 
college students belong to Greek societies. Conmuters are still, at best, 
marginal and almost invisible participants on many college campuses; if dropout 
rates are our guide, they remain an endangered species. Enrollments for ethnic 
and racial minorities are down in most schools, and those that remain have the 
predictably difficult time the miner ically few and different have amongst the 
numerically mrtf and similar* 

This breathless list of is' . «ri the natives' point of view is not intended to 
accoaplish much more than t r at ».hat it might be like to be a student those 
seemingly placid days* I'v; ..icked a few areas of troubling concern because they 
happen to be favorites of mine. I haven*t even mentioned an issue that crouds 
the pages of our new magazines >- the *Vou-pick-em" supermarket approach to 
course design and selection that o^ten leaver students befuddled. One of my 
undergraduate advisees captured this nicely a few years ago by asking quite 
seriously, "Do I really have tu take what t want again next term?" 

In sum, it appears that for many students who manage to get over the huip of 
college choice and entry, college life boils down to spending four or more years 
in a youth ghetto, scrambling for grades in courses of uneven quality and 
unfathomable sequence, socialized primarily by peers on a cultural island that is 
rarely visited by non-natives. Too strong? Perhaps. Pm not here, however, to 
soothe or calm the waters, but rather to stir them up a little bit. 

Ue come now to my senton and a few cautionary notes. I'd like to see institu- 
tional research ''ediscover something of its heritage. Pointecily, I'd like to see 
institutional research concerned less with managerial than with student and 
educational matters. I don't believe college is, at heart, merely a business to 
be mana^c^ calculatedly with some cold, bottom- line or rate -of -return in mind* 
To be sure, there is a political economy in which we must all somehow swim and 
survive* Plans, forecasts, market studies, systems analyses, wage surveys, and 
estimation procedures must therefore play a part. But there ic much more to 
Uiisper in the ear of college administrators than the results of the latest nose- 
count calculus. 

In particular, we need some indication of what happens t.'t our students during 
their college years beyond the fact that many of them pc.sist in completing 128 
credit hours and gaining a degree. I submit that we don't know very much about 
student life and culture on our own wampus because we don't try very hard to 
learn. Inputs and outputs are thought to be what counts; hence, they are whet we 
measure* Ue probably know far more about our students before they enter and 
after they leave than we do while they are with us. I think this short-sighted, 
for if we are to menage education better it is with the process of education 
tself that we must begin. 

The educational process is not captured well by frequencies or statistical 
sumaries* Process entails experience, and experience is best captured by 
narrative. Descriptions of student lives- in-progress are required* On this 
matter, institutional research, broadly ^fined, has had considerable past glory* 
Ted Hewcomb, Howard Seeker, Edgar Schein, David Riesman and Burton Clark, to name 
a few, have all pointed to the distinctive, yet varied, mix of cultures conveyed 
by colleges. A favorite example of mine is Ben Snyder, who, in the mid -60s, 
carried ou** marvelous little study through the Division of Institutional 
Research He added the phrase, "The Hidden Curriculum," to our vocabulary 



6 





•4tUe provoking some much-needed change In the way student cultures were treated 
at the Institute (Snyder, 1971). 

Uiat makes the work of these people outstcjndiiig examples / institutional 
rawarch is its ethnographic or descriptive character and the serious effort to 
portray college life from t^e student's perspective- In these coirpetitive times 
of cost consciousness end outcome obsessions, students tend to get lost in the 
shuffle. A sophisticated office of institutional research, however, has to tnink 
holistically about college life. It must ^hink qualitatively as well as quanti- 
tatively, about cjlture as well as structure, in the language of students as well 
as the language cf managers. 

There are no obvious reasons why simple, open, descriptive studies of various 
student groi^ cannot be developed and distributed such that the pressing and 
sometimes urgent views of these groups can be heard. We lack, not the skill, but 
the will to do such work. Straightforward ethnographic work of the sort I have 
. mind requires only a target group to talk to and some paper and pencil to 
record what is learned. This is not a high-tech activity. High-powered /inalytic 
models do little more than get in the way. Our etudents are hardly shy, wily 
ratives intent on keeping the anthropologist out of the village. They are more 
than pleased to speak on matters of personal concern. I have in mind, of course, 
more than a take-a-student-to- lunch program. Uhat is needed is a systematic, on- 
going, pulse-taking activity designed to describe, not prescribe, student 
concerns and activities. To twist a phrase, th^re is nothing so prac^'cal as a 
good story. 

Ethnographies, be they native, professional or amateur, are what I wish to 
encourage. Glimpses Into the odd corners of our institutions are not only 
matters of intrinsic interest but are often sparks for creative problem solving 
and further inc^iry. Vffiat are our typical campus visits like? How is life lived 
in Bill-Jim Hall? What happeni> during a day in the I'fe of an Hispanic freshman 
on a lily-iiiite campus? These are not statistical qiestions, but questions of 
value and meaning. Such mundane iirponderabilia are the stuff of which college 
life consists. Without some knowledge of the student culture, we surely lose 
sight of what college is about. I have no illusions, of course, of a science of 
ethnography. It is an art, b craft, but no less an art or craft than some of the 
highly- rationalized, yet narrow, anal/tic models we spend so much time developing 
and fine-tuning. 

In brief, so much of what passes for information collected and processed by a 
miversity about itself is rather empty of meaning because it possesses few 
obvious connections to everyday life on campus. To be sure, this is an age-old 
criticism; but with the astonishing increase in our ability to A\ce and dice 
information with our handy-dandy, desk-top conpjters, we may lose sight of what 
it all means. I am asking simply that student cultures be taken seriously and 
that we make an effort, however partial and primitive, to sketch out some of the 
concerns of the students who justify our presence on the college catifxjs. 

Of course, such work requires mobility. Cultural inquiry takes place on the 
ground where the objects of our affection are found. It requires listening to 
and learning from students going about their daily affairs. it ->>»t mean 
(shudder) taking in a class or two; hanging out at the student centei .or more 
time than it takes to wolf down a burger; or (gasp) visiting a dorm on a Saturday 
night. Tactics are multiple. Surveys, diary methods, intensive interviews, 
fijcus yroL^s, archival searches, bull sessions in the halls and quads all are 
possibilities. A tactic might be borrowed from anthropologists who make use of 
spot-reports from native informants. A good deal of ethnography goes on as 
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classroom assignments n many social science, education, and management courses; 
this work could easily be tapped. If we really want to get a better feel for 
what our institutions are doing to and for the inmates, we ha*/e many ways or 
generating the kind of narrative data we need. 

That we seldom do so suggests a final and perhaps gloomy point. Maybe we don't 
really want xh\s Information. Maybe if we had It we wouldn't know what to do 
with it. The history of organizational self -reflection of the sort I've Just 
mentioned Is, after all, not all that splendid or cc/nmon. There are several 
reasons that bear elaboration. 

Educational evaluation, as a field, was captured early by psychology and more 
cecently by various forms of economic analysis. This Is not accidental. Both 
areas represent the most "scientific" of our social research disciplines. From 
psychology, we receive our testing mentality; the science of Uiat is In people's 
heads comes complete with a technology for how to unload such knowledge. ?rom 
economics, we receive our various Input-output models and the proverbial black- 
box or invisible hand that trarisfonns one to the other. As a result, both 
disciplines present us with a never-ending stream of discoveries for how best to 
do X, Y or Z. 

The problem, of course, is the speed with which each discovery is replaced by 
another contradictory discovery. Large classes are in, then out, then In. Zero- 
based budgeting comes and goes. Forecasting or cost-containment models are 
adopted and discarded like Cabbage-Patch dolls. According to Howard Becker 
(1983, p. 99), it is all a little like child development, a "science" whose 
experts, on the basis of good evidence, advise everyone in alternative decades tu 
feed their babies on schedule or on demand. 

Uhy do we accept the authority of such patently problematic disciplines? It 
seems to me that one reason has to do with our need to offer proof that our 
educational plants are operating fairly, efficiently, and productively. Our 
swoon into the arms of quantitative, scientific, so-called objective techniques 
coincides with the broad d'Mnocratization of higher education, the standardization 
and routinization of education, and Its Increased competitive character. Time 
doesn't pemit lengthv elaboration, but, in a nutshell, I suspect the fundamental 
point Is that we promise more than we can deliver "to fulfill and transform." 
In the face of being called to task for our shortcomings, we seek to convince 
skeptics, friends, enemies, legislators, parents, boards, alun students and, 
indeed, even ourselves that our institutions are nonetheless being run on 
rational and defensible grounds. Enter, here, the neuf^al, fair, beige, scien- 
tific, qu >titative, and objective planning and evaluating icchniques as cultur- 
ally-approved means for providing legitimation and Justification for what we do. 
It Is form over substance. 

In contrast, subjectivity, sensitivity and judgment are the keys to the kind of 
assessment techniques I have in mind for institutional researchers. Alas, these 
methods ^un afoul of the legitimation and justification ftnctions served by our 
present research techniques bocwuse they so often spoil our pat explanations for 
why we sometimes fail -- explanations that frequently turn on the alleged 
Inadequacies of the students (psychology) or the marketplace (economics). 
Avoidance of ethnographic research is not direct (or venal) in the sense that 
administrators are saying that such research will let the cat out of tho bag, but 
there is, I think, an undeniable element of subterfuge in much of the research 
accomplished under th? institutional flag. This is at least part of the reason 
we (4)hold our "scientific techniques" with such zeal and why ethnographic, close 
to the ground, methods are so disliked. 
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The other part may well be more inmediate and self-preservational. !f we study 
our Institutions from the ground up (or "inside-cut"), we will eventually wind up 
studying everybody, including ourselves. One of the lessons learned from some of 
the exemplary works ! mentioned Ixfore is that stf dent cultures ere shaped by a 
wide array of decisions and non-deciaions tairei well beyond their borders. If we 
sniff around a student dorm, for instance, and discover that the faculty have not 
been seen since the Peloponnesian Wars, the faculty may well become targets for 
criticism. One of the 8urpr*'«s ethnogra^ves hole in store for people is that 
all groi|)s on campus are fair game for study. Moreover, members of these groifw 
know well that if people hang around long enough studying what they do all day, 
sooner or later they will find out things the people studied would prefer not to 
reveal* Ethnographers invariably oiscover such things. Their work is therefore 
profoundly evaluative, no matter how it is sold or explained. Their study of 
student cultures necessarily spins upw&rd, and while administrators may not mind 
studies that point to a few troublesome products, th?y will have great difficulty 
with studies that suggest it ii the production process i .elf that is to blame. 

Finally, two rather vexing utilization or implementation problems are associated 
with my call for narrative, qualitative research. Both surfaced during the brief 
heyday of field studies in higher education, the 1960$, when great hope was 
placed on the ''depth" of ethnographic research and its unarguable closeness to 
the facts of college life. Both are as relevant today as they were then. 

First, adninistrators are right I' concerned with running a tight ship and 
maintaining a proper image of their institution. They will have problems with 
research that stiinbles on drug deals in Founder's Hall, program directors using 
funds allocated for program innovation to cover operating expenses, or faculty 
who respond to publication and tenure pres^uics by sinply vanishing from campus 
for weeks at a time to write at home in the privacy of their studies. Adninis- 
trators want to know who these people are and what they can do to put an end to 
such shenanigrns. Researchers know, however, that if they go around informing on 
people, there lill be no people left to study. Perhaps a greater sophistication 
surrounding these issues now exists than in th^ past, but the issue remains a 
real one* Privacy, confidentiality, and a ricorous refusal to scapegoat individ- 
uals for institutional failures ^''e absolute, mor^l requirements for the kind of 
work I am shamelessly pushing. Unfortunately, this stance does little to enhance 
the status of ethnographic work in the eyes of adninistrators* 

Second, although ethnographic, judgmental, student -oriented research is inher- 
ently problem- focused, the solutions researchers propose may not be the ones 
preferred by decision-makers. Often, our solutions are not seen as '^practical." 
Typically, the problems dug up in ethnographic work are fmdamental ones and 
quite resistant to a so-called quick fix. Here is an example* I once produced a 
draft of a study I conducted on my own institution, the Sloan School (Van Maanen, 
1983). The faculty and administrators who read it -- by and large, only the most 
concerned arid serious of my colleagues wanted me to make recomnendations. For 
instance, in the report I described (apparently convincingly) how first -year 
master's students formeci tight little conf^^rming, risk-averse groups on the basis 
of being marched through coursework at the same speed, in the same order, with 
the same cohorts, and presented with precisely the same material* The result, 
since the students were put in the same boat by the faculty and administration, 
was that individuals wound updoing things together including homework, tests, 
term papers, and the like* That possibility appalled the faculty. I explained, 
however, that the batch -processing model promoted such a response and if they 
wanted something different, they could allow students rnore choice of when, where, 
and with whom they could take their courses. 
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Ny colleagues at this point were not pleased. What was the problem? Ny solu- 
tion, the program head said, would destroy the ease and economy the current 
scheduling strategy produced. It wouid be hard to track students and make sure 
they were fulfilling their requirements on time if we moved away from the block 
model. Faculty would surely complain because classes would become less standard- 
ized and students would be able to make more comparisons among them as to Mho was 
teaching well and who was not. Ny solution might work but, alas, it wasn't very 
practical or realistic. 

This, of course, is a fundamental problem. What the institutional researcher 
identifier as a cause when working from tny ethnographic model may well be 
something people can't or won't do anything about. Good social research, ft 
'earns, always makes some people uneasy if not angry. But more optimistically, 
only work that seriously attempts to get close to its subject matter, student 
cultures or anything else, produces the sorts of answers that are worth having-- 
in tt-j long run the only kind of answers that will work. If we are to manage 
edjcation better by attending to student life, institutional researchers, like 
field workers in sociology or anthropology, must learn to live with the critic's 
curse: the slightly marginal status that comes from doing good, reputable work 
that is viewed by the power holders as somewhat suspicious and dangerous. 

As long as colleges keep running into failure (and the converse is unimaginable), 
we must put the pressure on and force decision-makers to look at what they might 
otherwise prefer not to see. Being ment>ers of the very organizations we study 
helps in this regard, for our loyalties can be assumed to flow in the right 
direction. To live and work at a college or university is, as I said at the 
outset, a most attractive, self -enhancing and worthy situation. To help manage 
these institutions and try to make them bett«>r is a never-ending, noble, and 
downright enchanting task. 
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EXECUTIVE LEADERSHIP: THE PROS AND THE CONS 
(general session) 

Brunetta Reid Wolfman, President 
Roxbury Community College 

Burton I. Wolfman 

Higher Education Financial Consultant 

(This is an edited record of an address presented in the Count Basie Ballroom of 
the Vista International Hotel, Kansas City, No., on Monday morning. Nay 4, 1987.) 

The conference planning comnittee assigned 
this topic to us in true institutional 
research style: they were clairvoyant (in 
professional terms, attuned to forecasting), 
terribly trendy (translated to "relevant"), 
and perhaps diagnostic of prevailing societal 
anxiety. The Washington* I ran*Contra crisis 
and the Tower Coami ss i on rep^ " t focused 
national attention on managerial style and 
its consequences as we saw the divergent 
styles of President Reagan and Chief of Staff 
Regan play against the ;nplicit account- 
ability standards of electoral politics. The W&shington s:.andal 
only the problems of managing effective policy, but also the 
loose organizational control. It reflects the ways in which managerial styles 
interact and can come into conflict. In this discussion, we try to convey our 
views of the effective manager/ leader in higher education. 

The Chief of Staff Regan model demonstrates the fallacy of the generic manager 
whose skills, style, personal attributes, and concepts of the prerogatives of 
office transcend tho organization and 'ts inherent value system. The generic 
model is that of the corporate world as ;t has evolved from the scient^'flc 
manaqement of Frederick Tavlor and successive generations of analysts adapting it 
to modem terms. It has been argued that the corporate/ industrial managerial 
model could be applied to all large- scale service delivery systems since they are 
all concerned with control of scarce resources, financial and human, and with 
developing conmunication systems, fci mlating policy, and defining criteria for 
accountability. However, the imposition of the corporate model on higher 
education results in an imperfect fit because of the diversity of our institu* 
tions and the multiplicity of crviflict'ng goals within them. We are not an 
industry, but a conplex of service and certification systems. 

The only commonality which cuts across the educational system is the responsibil- 
ity for the transmission of knowledge (to borrow a term from program budget ing> 
through a defined curriculun and a faculty. Are educational institutions managed 
and, if so, are they managed by the president? Certainly, there are people who 
exercisi fiduciary control, regulate the appointment, progression and termination 
of staff, enter into contracts for services and goods, solicit and accept gifts 
and/or appropriations, p*:.(.riculate mud grade students, and certify their comple- 
tion of programs. People doing these tasks administer or manage the activities. 
Does the collegiate president manage the tasks, the managers, or both? Are the 
requirements for leadership the same in educational settings as in the for-profit 
sector, where the CEO must take risks, define products and markets, and be 
accountable for those decisions? There are many simil'jrities between the tasks 
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and duties of the corporate CEO and the academic executive leader. There ere 
also profound and substantive differences In their respective claims to authority 
to deal with control, uncertainty and future pUnnlng. Should we become comfort- 
able with the corporate leadership model in an academic setting? Ue argue that 
the corporate model Is Inappropriate and at best Is a forced fit for an educa- 
tional setting. Ue also argue that Its use distorts and clouds the analysis of 
the educational executive leader. 

The fact that higher education has different and distinct organizational set- 
tings, e.g., two-year, four-year and university, perhaps is not markedly differ- 
ent from the diversity of Industrial centers which organize resources for 
production. More to the point. It Is the sponsorship end funding of higher 
education which makes the educational system virtually unique in the world of 
conplex organizations. In addition, the governing structures defining the 
relationship among faculty, students and staff guarantee a complex system unlike 
any ocher. If we can arcept this concept of uniqueness, then we must also accept 
that the criteria for management, or more precisely leadership, must be different 
In style, preparation and Implementation. Before saying more about these issues. 
It might be helpful to look briefly at the relationship of funding sources and 
governance and their iirpact on leadership. 

Publicly-sponsored Inst i tux Ions, dependent on an annual appropriation, Impliclty 
and sometimes expllclty Include in the governance equation the Governor, the 
legislature, a statewide coordinating or regentlal board and Institutional 
trustees. While vhe Institutional board may have statutorially delegated 
authority to govern, the Influence of the public especially on those who are 
elected cannot be far 'rom the ment)ers' consciousness. To the extent that 
students, staff, faculty ano alumni are politically active in electoral politics, 
they at .0 have a significant voice In the determination of governance ^'ssues and 
priorities, all of which have direct bearing upon (Executive leadership. The 
funding Imperative Is the spector which haunts the college president. 

In the Independent sector, where funding is more dependent upon tuition, volun- 
tary contributions from alumni. Institutional friends, corporations and/or 
special governmental grants, the governing board itself sets Inst 'tut ional 
pa ramet ere but Is Influenced by its dependence on funding sources. These sources 
can provide opportunities for greater autonomy and flexibility but are also 
inherently more uncertain. One coulJ argue, in this context, that the most 
autonomous Institutional executive would be the one who presides over a totally 
tuition-driven Institution (not unlike the corporate CEO with one product line). 

Certainly resource acquisition either from the legislature (In the public 
sector), alumni and/or corporations (In the Independent sector) leads the list of 
external factors dictating to the presidency. Internally, faculty participation 
In governance Is another critical component that varies substantially among 
Institutions, depending on collective bargaining agreements and teaching or 
research missions. Student satisfaction or unrest can also Influence the choices 
of the president. Insuring enrollment Is probably the universal driving force In 
all educational settings. 

Another significant difference bet "^n the corporation and higher education Is 
the letter's focus on the developmental needs and goals of people indeed, 
today, on people at all stages of the life cycle. The contenporary college may 
have educational programs for toddlers, your^g adults and the elderly. Learning 
Is presumed to take place In many settings, in and outside the classroom. The 
culture of the system centers on the development of hunan potential, implemented 
by the transmission of knowledge, the preservation of knowledge and the creation 
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of new knowledge. The leader of such an enterprise must be a more complex leader 
than in any earlier era of higher education. 



Inherent in the culture of higher education is anfeiguity about definitions, 
roles, responsibilities and futures; lack of certainty traditionally is associ- 
ated with scholarly settings and lives. The tugj between the past, present and 
future are always apparent and provide some of the excitement in an academic 
setting. Different constituencies students, faculty, aluini and board-- 
often hold vastly different criteria for the chief executive. Given the confused 
and conplicated setting, how does one begin to develop a pr^ /pe of an effec- 
tive educational manager/ leader? 

Let's start with the past, the traditions. Our institutions are not all co\«red 
with ivy and moss; most are raw concrete or brick, but they emulate centuries of 
tradition in patterns of thought and behavior. There is a need to create a tie 
to the past, a link in the chain of academic continuity that may only be glinpsed 
annually at coirmcncement . A president chosen to provide continuity with the past 
may be an alumnus or a product of an esteem>Ni, ancient :ollege who will bring 
high culture and reflected glory to the campus. Such a president may be a iwans 
for the college to increase its prestige and self-esteem. A president with a 
clear tie to tradition may represent standards of excellence toward which the 
institution strives, and these standards may be a source of contention between 
constituencies. Or, the president may be chosen to revive lost traditions at the 
college, another possible source of friction; the choice may represent an episode 
in a continuing internecine struggle, the ascendancy of one faction over another. 

There are many instances when the traditional president comt, with a clear ^ense 
of being one of the select few, anointed with a divine n^t to rule. Signs of 
imperial majesty will begin to appear and will reassure many that the president 
has "real class" and the campus will benefit from the new elegance. However, 
most boards particularly those in the pUblic sector do not take well to 
displays of affluence and majesty. The regal CEO may not be a person who 
believes in working in a collegial fashion and uses the hierarchical model of the 
medieval monastery or the structure of the laboratory research group. This may 
be a style favored by a board which wants to set things right and return to the 
"good old days" because the place needs "shapir^ up." All boards, private and 
public, have a herd time dealing with presiding monarchs who, like the Red Queen 
in Alice in Wonderland, often have as a favorite refrain: "Off with his head." 

Another return to the good old days may be the selection of the "robber baron" 
president, the entrepreneurial, acquisitive manager. A board may select this 
president because its mefit)ers are terrified by the threat of declining enroll- 
ment, loss of income, or a diminished sense of mission. He/she is chosen to give 
the institution a cWge, a direction, a conpetitive edge. Studies may be 
coimiissioned which indicate the strategic advantages of moving in one direction 
or the next, beginning one program or dropping another, using "celebrity" 
adjuncts, advertising or moving into new territories which are unserved b/ any 
other higher eckication institution, in addition, the robber baron president must 
cultivate new donors and patrons who will provide scholarships, endowed chairs 
and discretionary money for honoring his/her geographical area or coninercial 
area. The cut-throat entrepreneur will not cooperate with other institutions. 
He/she is interested only in the bottom line (more student enrollments) and the 
market forces which are dictating new programs. He/she will also rifi roughshod 
over faculty who want to use the time-honored methods of shaping and instituting 
academic programs. Some faculty will be casualties in the process: they will 
not survive the wars in which the baron president has greater fire power and 
resources, plus the merit and tenure of authorization. 
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Another traditional president is tne conservator of the faith, be it religious, 
gender or racial. The president must be one of the group and have the experience 
and feeling to understand the importance of survival. We can look aromd and see 
evidmes in the institutions created by the various religious and racial/ethnic 
groups, and in single*sex colleges. They all came out of the striiggles of their 
group to become a part of American society without losing identity. These 
institutions are needed still because they preserve a sense of self and succeed 
only if they understand their heritage and their tradition in this cointry. The 
1980s are not an easy period for single sex, historically Black or sectarian 
colleges, because the forces comnitted to wiping out differences in the interest 
of the majority are using the force of public opinion, the courts and acfcninistra- 
tive judgments to destroy this distinctive aspect of American higher education. 

The president who may be selected to be the chief conserve tor plays a very 
important role as spokesperson of the particular groijp and major interpreter of 
the conmunity. The president of a women's college must be able to articulate the 
value of that institution, the reasons that it is not an anachronism. The same 
is true of the president of the historically Black college. The conservator 
president often becomes a national advocate for his/her group and a reminder that 
the diversity of American higher education is fragile. 

We have other kinds of presidents who are very much with us. There i& the 
wonderful "day by day** presidential manager. He/she is terribly relaxed, a great 
source of comfort and even fun, because there are no crises which cannot be 
handled. Personnel problems, budget crises, enrollment shortfalls are all things 
which can be overcome in a relatively calm manner, or they will wa^t until 
tomorrow. The *'que sera** president is a calming influence on disputing factions 
and is able to pull all factions together whenever there is an attack from 
hostile forces from the outside. In fact, this style merges into the crisis- 
manager president who is immobilized until there is clear and present danger. 
This style is among the most common at the present time, when the expectations 
for leadership are rather low. 

The crisis martager was in fullest glory in the late 1960s and early 1970s, a time 
for student, faculty and administrative tests of strength. He/she did not 
anticipate disruptions or problems until the police had to be called or the 
institution was not functioning. Today's crises may be caused by a racial 
confrontation, a tenure decision, an increase in tuition, changing the rules for 
any aspect of campus life or b^ a season of the year which encourages volatil- 
ity. All of us carry in our hearts a secret dread of spring. The crisis-manager 
president has the capacity to arouse more activity and passion on the part of the 
staff than one might imagine possible if one looked only at the normal lethargy. 

In the real world, there are no clear distinctions among these styles, and 
elements of each may be found in one president. It is also probable that 
institutions need leadership akin to one or another of these types at different 
times in their h:story. Probably any college would be worn to a frazzle if 
subjected to decades of the same tenor of leadership. Nost institutions seek 
situational leadership which accommodates to the student and faculty profiles and 
the inner demands of a particular time. This is somewhat different from defining 
situational leadership as a response to a given context; we propose that the 
context defines the kind of leader who is neec^. The situational leader often 
is a person who arises out of the group, one who understands and can articulate 
the very heart and soul of the institution, represent different factions and 
forge consensus about the present and the future. The situational leader is more 
likely to be found in a peer-driven academic department or self 'contained unit 
than in the larger institution. A situational campus leader may emerge for a 





brief period ii\en there is social fervor and turmoil, »jut he/she is unlikely to 
adapt to a more bureaucratic mode of leadership when the crisis subsides. 

Since the great ecfcicational upheavals of the 1960s, all of our institutions have 
been forced to incorporate into institutional procedures the requirements of 
affirmative action, consultation with constituents and, often, the conditions of 
collective agreements. As a recent Association of Governir^ Board study directed 
by Clark Kerr notes, many of the most able candidates withdraw from presidential 
searches because of the public notoriety of the process. Moreover, many searches 
begin with incomplete agreement about the job description of the executive ml 
the future desired for the institution. The essential nature of the selection 
process should be an attempt to define the future and identify the individual who 
will lead the institution to achieve the agreed-upon goals. Too often, it is 
symbols of the office and stereotypes of the executive personality that prevail 
rather than a vision of the future. 

Since the end of the World War 11 and the concurrent dramatic inpetus for the 
growth of higher education, we have experienced rapid growth, accelerated 
research and scholarship, a backlash caused by alienation to inpersonal settings, 
demands for inclusion, scarcity of fiscal resources and now a scarcity of hurmn 
resources and clients. During the growth years, the president was required to be 
the advocate for growth: more buildings, more faculty, more programs; the demand 
for educational services needed to be met. The less government interference, the 
better, because red tape delayed implementation of growth. During the years of 
revolt and backlash, the president was required to be "cool," fend off critics 
from all directions, protect his or her board and then get out before too inany 
negative decisions created too many enemies to survive in office. The president 
of today must manage scarcity. For a period of time, when financial resources 
were becoming scarce, there were those who argued that cost analysis and related 
corporate strategies were needed to govern and manage our institutions. Such 
tools were helpful and they remain a part of the culture of our institutiofw; 
however, they are not enough. Presiding over scarcity requires, not more cost 
effectiveness or greater efficiency, but rather a clearer i^rstanding of future 
human needs. It is the loyalty of an iitstitution's clients which will determine 
Its ability to survive. 

The CEO of an institution or higher education, regardless of gender, racfal 
origin or religion, is the self-fulfilling prophecy of the institution, the 
product of the dynamic hhich produced his/her appointment. The quality of 
leadership, the president's intellect and managerial skill arise from inplicit 
and explicit mandates of the search process. All too often when a Board begins 
the search for a new executive/ leader, it has before it a well-defined list of 
grievances attributed to the prior executive. Whether these grievances can be 
substantiated or not, those aggrieved are usually included in xhe search process 
in the hope of obtaining institutional consensus, in many instances, because of 
this faulty pursuit of consensus, the search process starts from a base of 
mediocrity from which it may not be able to recover. Strong candidates know that 
they cannot be all things to all people. 

The Board and the search process, at their best, can articulate the goals of the 
institution and the milestones capital campaigns, new degrees, etc.-- 
immediately ahead. The search committee then evaluates the candidate pool on the 
basis of skills, styles, past experiences and ability to articulate a vision. We 
would argue that the search process which is too heavily guided by the frustra- 
tions of the past is doomed to produce transitory presidents. The transitory 
nature of the presidency is often masked by a "code of the club" which says long 
tenure is impossible because of external factors, or the internal demands are too 
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great. The problem may rather be inadequacies in initial job description and the 
search process. Head hunters, in some instances, are able to force a board to 
articulate its needs in a more objective and strategic fashijn. Ue have all 
heard that most people who profess to wanting to be presidents are wrong for the 
job« that frequently the "best" candidate does not seek the position. If we 
believe that the context defines leadership, then the position should seek the 
candidate. 

What is needed? W% argue, based on our experience and understanding of the 
higher education system, that there are two fundamentally successful presidential 
models, the Entrepreneur and the Prime Minister. Although the titles suggest 
references to business and politics, we will place them in the setting of higher 
education. 

If an institution, pii)lic or private, is tuition-driven, there is no avoiding the 
bottom line, enrollment figures. The executive in this setting must be able to 
manage or direct resources, human and fiscal« to meeting enrollment targets. 
He/she should either be skilled in the art of consensus or be skillfully autocra- 
tic so that staff morale does not negatively affect the primary goal of enroll* 
ment. The Board in this type of institution tends to delegate to the executive. 
Faculty may abdicate any leadership potential since all efforts are directed 
toward the effective management of tuition resources. 

Increasingly, however, the Entrepreneur cannot rely on tuition revenues to 
support the institution and must seek additional funding from alumni, corpora- 
tions, governmental sponsors and individual patrons. The entrepreneurial 
president must be able to sell the mission and products of the college to the 
potential backers. This is unlike the role of the corporate CEO, who may have 
been in sales early in his/her career but is not required to continue the role as 
the head of the organization. The growth of endoMnent, new buildings with donor 
names on them, scholarships are tangible evidence of the success of the presi* 
dent*s efforts. 

To the extent that the Entrepreneur can bring new resources to the institution, 
he/she can dispense rewards to individuals and units which have displayed loyalty 
and dedication to the president *s objectives. A new type of patronage system may 
evolve to reinforce the direction of the leader, but this need not result in poor 
educational quality. On the contrary, if the Entrepreneur succeeds in obtaining 
surplus resources, the quality of the institution will increase. It is institu- 
tions caught with inadequate resources, a confused sense of mission and unfocused 
leadership which run the risk of pof^r educational quality. 

As long as the Entrepreneur has a vision for the institution and is able to bring 
resources to meet the needs, he/she will be able to lead. If for any reason, the 
leader loses the vision or interest, he/she will probably be replaced. 

This president is the spokesperson fcr the reigning majority, the dominant 
faction in the institution; he/she reprt^sents and is able to articulate the 
interests of what is likely to be a coalition of diverse constituencies: 
faculty, students, alumni, legislators and/^r trustees. Leadership and consen- 
sus* building are the most apparent skills of thi^ type of president, along with a 
visionary grasp of the institution, the external environment and the future. 
Charismatic force which will help provide the momentum lOr the institution to 
marshal the human and fiscal resources to sustain itself. Often, the constant 
and continuing flow of resources are dependent on the clarity of the mission, the 
constancy of the implementation of that mission, the degree of inclusiveness of 
the constituents and the loyalty of those constituents. 
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The Prime Minister is best able to speak for the future if there is a legiicy 
shared by the constituents of the institution; he/she is able to capture dreams, 
aspirations, and shared memories, 'and can comnunicate these aspects of the 
institution's culture to the larger world. 

This type of leader primarily delegates management to important line officers: 
Administration/Finance, Academic Affairs, Development, Student Affairs, Legal 
Counsel. The critical managerial task for the Prime Minister Is to hold the line 
officers accountable and to get them to work together. It is helpful if the 
Prime Minister has analytical skills to assist in the evaluative tasks of the 
institution and a^iticipate and plan for decision-making. It is the Prime 
Minister uho has to help resolve conflicts, prevent any rents in the consensus 
fabric and keep the coalition moving forward. Since his/her essential power is 
shared, decisions are seldom arbitrary, made in haste or isolation. The Prime 
Minister must alf o be a resident critic of the coalition, because a failure to be 
critical of existing practice makes the Prime Minister and the coalition vulner- 
able to external attacks and internal erosion of confidence. The criticism. 
However, has to lead to corrective actions based on collective solutions. 

The Prime Minister should be able to chart a new course and to lead the coalition 
to new levels of participation and institutional understanding. It is this 
leadership which will justify the acquisition of new and additional resources, 
the development of new knowledge, the changes in adninistrative configurations 
and academics. The Prime Minister will inspire and encourage others to an.tlyze 
and dream and implement the dreams, thus contributing to the coalition's growth 
and progress. 

The Entr^reneur and the Prime Minuter share a primary motivation arKi great 
asset; they are institution buildet^. They may represent extremes of style, 
particularly wit^ respect to management anrf uses of information, but their drive 
and success are measured by institutional growth and development. This does not 
necessarily rrean that there must be physical growth; but the impulse toward 
excellence is an indicator of growth, perhaps more important than new buildings. 
There will be indicators of vitality and excitement, involvement of staff, 
conmitment of various constituents to achieve the goals articulated by the 
leaders. The Entrepreneurs and the Prime Ministers are the real "PROS" which 
make higher education a distinctive, vital contributor to the American society. 
They are the givers, the sharers, the nurturers, the builders. 

The "CONS" are those presidents who allow their personal style, weaknesses, and 
personal aspirations to be the focus of the institution's activities. It is this 
group which detracts from growth, because they are the takers, caught up in 
personal ambitions to the detriment of those around them and the institution. 
They leave a legacy of few accomplishments and bitterness* 

In light of these styles, what is the role of institutional research? In the 
early years of your craft you were the nunber crunchers, the nose counters, the 
definers of square feet of building space and classroom utilization. With the 
advent of computers, you were elevated to analysts, systems and otherwise. As 
scarcity became a factor, you became forecasters and planners of all sorts of 
trends, some empirical and some impressionistic -- and on occasion even diWne! 
As institutional management weathers successive crises, institutional research 
gains in legitimacy and moves closer to the source of power and decision-making. 
You have becoire translators of some parts of the past and soothsayers of the 
future a remarkable synthesis if one considers that you are barely a recog- 
nized profession, let alone a sciencel In all seriousness, you have become a 
part of the institution*bui Idir'^ resource. It is institution*bui Iding that is 
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the key and link to the presidency of the institution. Yuu provide the informa- 
tion needed by management to build institutions. The president who uses your 
information for building enhances your role. If the leader is not a builder, 
your information has only marginal utility. 

Your coimiiiment, then, is to professional activity uhich contributes to institu- 
tion building, because it is by strengthening the diversity of the American 
higher education system, by expanding the capacity to address the needs of our 
people, and by preparing competent, educated citizens tha». we who work in higher 
education will ensure that the legacy of the past *s fulfilled in the future. 
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INFORMATION '/-ECHNOLOG Y: USING IT IN RELEVANT WAYS 

(general session) 

Chriftine V. BuIIen, Assistant Director 
Center for Information Systems Research 
Sloan School of Management 
Massachusetts Institute of Technology 

(This is an edited record of an address presented in the Count Basie Ballroom of 
Che Vista International Hotel, Kansas City, Mo., on Tuesday morning. Nay 5, 
1987.) 

Recent History 

The moat familiar way of looking at the history of information 
technology is to look at the changes in the technology itself. 
In the early days of computing the only technology available 
was the mainframe computer. At different points in time, the 
size and capability (not to mention price!) of mainframe 
computers differed enormously. The earliest mainframes were 
huge in size (occipying entire floors of buildings), less 
powerful than today's small personal computers, and so costly 
that they were found only in research laboratories. As 
computers became available commercially, size decreased, power 
increased and cost was dictated by the market. Until the late 
sixties, the major technology changes in computir^ hardware can 
be described as dimply increasing the "bang per buck" i.e. delivering more 
power for less cc^t to the customer. 

The fi'^t revolutionary event in this short history was the development of the 
miniconputer. Compared to today's standard of a personal conputer, a mini* 
computer is still a large, mainframe-type computer. However for the data proces- 
sing departments of the sixties and seventies, the concept of a computer that 
could operate independently of the mairi.ame and have the horsepower to do 
something useful was mind-boggling. It was also threatening. One of the 
problems with focusirq on technological change as one traces the history of 
information technology (IT) is that one tends to overlook the social, political 
and environmental changes that were also taking place. 

It is useful to think of the evolution of IT in terms of two paths: 1) the 
technological path itself, and 2) the path which describes how the technology was 
being used. The days of the large, expensive mainframe conputers coincide wi^h 
the days of using computers as mirber crunchers. Early data processing profes- 
sionals understood how computers could be used for tracking accounting data and 
carrying out jobs that involved wel I -structured, repetitive tasks. Because of 
the costs of these large beasts, data processing was assimeu to be a corporate- 
wide function and the computer tool was, therefore, applied only to corporate- 
wide tasks. 

Some of these notions began to change as the con apt of time- sharing developed. 
It was discovered that since the computer's ability to perform operations was 
much faster than a hunan*s ability, it was possible to have the computer perform 
operations for m^y people at the same time, without any one user's work 
suffering. This time sharing concept was enriched to the point of providing 
computing services to users outside of the traditional data processing community, 
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e.g. to scientists and engineers who needed conputing power for their projects. 
This was the first step in the truly dramatic change that is stiU evolving 
today: end-user computing. 

That tedinological change must go hand-in-hand with use change is obvious. 
However, innovation research has shown that* by far, the majority of innovations 
in the use of equipment (whether we are talking about farm equipment, or informa- 
tion technology) come from the users themselves. Innovation is not, as is often 
pictured, simply the result of some brilliant inventors creating behind closed 
doors* The more the users outside the traditional data proceesing departments 
foufxl ways to eoploy the computing tc^l, the more pressure there was to bring the 
cosputing power to them in the most efficient t^rd effective ways. These, then, 
are the events which led to the development of the personal ' nputer. 

The sixties and seventies saw ideas about lement information** begiii to 
blossom. The first concepts were very primiti vonsisting entirely of aggrega- 
tions of data that could be drawn from the masses of accounting nunbers being 
tracked by the mainframe computers. Grandiose plans for **management information 
systems** based on this approach failed miserably and in so doing caused the 
disillusionment of many practicing managers. Here is the origin of unpleasant 
terms like **management misinformation systems,** and the origin of total mistrust 
of data processing organizations -- their projects were always over budget, late, 
and never succeeded in performing as planned. It became general knowledge that 
the only th ng computers were good for was nunber crtmhing in large, highly 
structured tssks. 

Fortunately, there were a few researchers and enlightened DP professionals who 
pursued the ideas of designing information systems to suit managerial needs as 
opposed to looking at the data available in the accounting systems and trying to 
force-fit management reports. This work actually took two distinct directions. 
One was pursued primarily in the academic wor ' ' and consisted of designing 
systems that assisted I'sers in carrying out their tasks. Since many of these 
tasks involved gathering data on a particular situation and then coming to a 
decision based on that data, these systems were termed Decision Si^sport Systems 
(DSS). 

One aspect of DSS that was quite different in philosophy from previous system 
design was that the system ASSISTED, i.e. si^jported the user by performing time- 
consiining, structured activities that resulted in information which the user then 
considered and upon which the user made decisions. Neither the system alone, nor 
the user alone, was as powerful as the ccmbina *on. Previously, many systems 
were designed to REPLACE the human, e.g. check*writing systems. Traditionally, 
DSS involved the user actually manipulating a conputer (generally through a 
keyboard) to perform operations ranging from searching data to buildir^ models. 
In the early days, DSS were built on timeshared mainframes. An early DSS 
requirement - no longer required was that the system include modeling. 

The other design approach, pursued primarily in the business environment, was to 
understand what information managers needed and provide that information in the 
form of printed reports. This was an improvement over the simple aggregation 
approach; however, this too encoititered many problems. The task of understanding 
what information managers needed and how they used the information available to 
them was, and is, an extremely difficult and complex task. In effect, the 
problem was how to design relevant information systems. This is still the chal* 
lenge today. 
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What is Relevance ? 



Support vs. Replace- There have always been different schools of thought about 
how to make computer-based information relevant. One way of looking at this is 
to divide the afaproaches into two, differentiated by the key philosophical point 
of support versus replace. 

Since the first use of co^. ^ers was based on the notion of replacing himans or 
substituting coinputing power for human power, this approach has always been a 
powerful one one pursued by many in the field. The first large mainframes 
took over repetitious, time-consuning, structured tasks. Even with the advent of 
the notions associated with DSS, the computing power was being used to replace 
human time in the structured tasks of searching data and performing calculations. 

In today's most advanced technology, one can still see this approach in the 
design of expert systems and in the study of artificial intelligence. Expert 
systems are an attempt to model totally the behavior of key experts in a field in 
order to REPLACE the individual with the computer. Artificial intelligence work 
is an atteopt to build a computer that can learr to think like a person and 
therefore perform peoples' tasks. 

Other than in the early applications of computers to structured tasks, most of 
these attempts to replace people have failed. Expert systems have succeeded in 
certain domains, e.g, medical systems, exploration systems and computer con- 
figuration systems. One of the reasons for success is that these domains involve 
a fair amomt of structure: a patient exhibiting a certain collection of 
synptoms almost always has a specific medical problem. For example, the MYCIN 
expert system was developed at Stanford University for medical diagnosis and 
prescripcion, NYCIN associates a patient's symptoms with an appropriate list of 
diseases. MYCIN and other such systems then assist the medical professionals by 
suggest^r^i additional tests, diagnoses and, finally, a treatment. However, in no 
case is a patient treated on the basis of a computer diagnosis alone, Hunan 
intervention is always present. In that sense, even these successes are not 
really examples of expert systems in their pure form. 

Rather they are exanples of expert SUPPORT systems — the latest incarnation of 
decision 8if)port systems. Expert Support Systems, or ESS, use the powerful tool? 
of expert system design, such as knowledge engineering, to closely model the 
performance of an expert in a particular field, but with the explicit goal, not 
of replacing the individual, but rather of enhancing the non-expert*8 ability to 
perform. One could certainly view ESS as a new level of understanding in the 
design of DSS. DSS design has traditionally attempted to create a system with 
tools to assist the individual. In some cases, these tools are already used by 
the individual, either manually or in a computerized form. In many cases, 
however, the designer attempts to create a new tool based on his/her under- 
standing of the issue or task, not on the expert user's normal modus operandi. 
Therein lies a key difference which hints at the potential for ESS. 

Designing Relevant Svstems- There has always been one major stuni>ling block to 
designing relevant systems: understanding the task to be performed. By this I 
mean that not only the designer must understand the task, but m user must also 
understand the task. By far the majority of disasters f-i the bL,ilding of 
information systems have been brought about b^ the fact that the users themselves 
did not fully understand the tasks or processes or their owri logic in carrying 
out their tasks. Therefore, they could not possibly conmunicate the information 
to the designers who would need it in order to build a system to support the 
tasks. Another disaster scenario involved redesigning office procedures at the 
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um tim at automating them. Under these cfrciinstances there was little chance 
anyone could understand the ramiff cations we*' enough to design the information 
system competently. A passing comment: cuese disasters were almost always 
blamad on the information systems department and ''conputerization,** thereby 
further damaging the department's reputation. 

The kay to this challenging problem is finding ways to understand the work to be 
dona before embarking on information system design efforts. One approach to DSS 
design is called breadboarding. Breadboarding a system means coming up with a 
working model very quickly in the design process so that real users can try it 
out it? real situationa. This is also called evolutionary design or adaptive 
design. These terms refer to the notions that: 1) using a model system will 
help the designer and user better understand how the task can be supported, and 
2) actual use of a syst^ will cause the user to evolve and change through 
learning. This user growth will require parallel changes to the system. For 
example, a financial analyst is given a ccnputer tool which can perform the time- 
consuaing calculations necessary in his daily work. His usual approach involves 
doing a minimal number of calculations because of the time and effort involved. 
With the computer tool he can do more in*depth analyses, look at more alter* 
natives, and develop models for the behavior of certain variables in his anal- 
yses. The more he uses the tools, the more tools he wants to use! 

If all this soiixto RUShy and hard to get your arms around, then you are beginning 
to understrnd the immense difficulty of designing relevant information systems. 
And you can see why the traditional methods of system design which attempt to 
conplete system specifications and obtain user "sign-offs" prior to any proto- 
typing often fail to result in useful information systems. 

Another approach involves inproving the communication between the user and the 
designer during the initial phase of system design, called requirements analysis. 
The traditional methods, which date from the large accounting* oriented systems, 
do not get at the heart of the task or process, but instead examine the siper- 
ficial aspects of the work: how forms move through the organization, which 
process ujxtotes which information, what signatures are required in what order, 
etc. 

To improve the ability to understand the work, several methods have been devel* 
oped by researchers, vendors rvnd management consultants. What these methods have 
in common is to approach the requirements analysis step with a plan for user 
interviews, conducted in a language that can be understood by practicing manag- 
ers, that delve into the work itself. 

One of these methods was developed at the Center for Information Systemr> Research 
(c:SR) at MIT and is called the CrUical Success Factor (CSF) method. Briefly, 
this method involves asking the interviewees to identify the factors in their 
work that are critical to the successful accomplishment of their goals and the 
mission of the office. The method carefully avoids talking about com^iuters or 
information systems and keeps the dialogue to a discussion of the work and the 
domain of the interviewee. Not only does the interviewer gain an ii^rstanding 
of the work, but almost always the interviewee better understands his/her work 
through making explicit critical factors which ha.e often been inplicit. 

Once the requirements analysis has been carried out in this manner, the task of 
designing systems to support the individuals ir accomplishing their missions can 
proceed and have a greater change of success. 




The analogy between this approach and the expert system approach of knowledge 
engineering can N<e seen. Each Interviewee Is considered to be the '*expert** In 
performing his/her job. Well-chosen questions must then be asked to capture the 
knowledge within the Individual knowledge which the person has often never 
before made explicit. By focusing on critical success factors, the interview 
gets tc the heart of the business rapidly. 

Inpects of the Use of Information Technoloov 

Like the upe of any techr^logy, the use of information technology can have both 
positive and negative impacts on an organization. The particular problem which 
has besn associated with IT is the unexpected Impacts which have occurred. Nost 
of these have been in the area of organizational politics. 

Too often the introduction of a new information system is coupled with the 
introduction of new procedures: "streamlining the process/ reorganizing the 
clerical staff, changing some reporting relationships, uhen these new procedures 
threaten control or power, in a real or perceived way, the people affected f i^ht 
back. This can take the form described by Peter G.W. Keen as a "counter inplemen- 
tstion plan"; the affected people use subtle measures to make the new procedures 
and systems fail. One very effective way of doing this Is to provide the wrong 
information to the system^ thereby causing the output to be useless "garbage." 
M. Lynne Narkus reports on one case study where an information system was made to 
fail completely through subtle sabotage. No one could understand why it wouldn't 
work until an objective consultant arrived on the scene to sort out the problsnm. 

This kind of negative inpact c^ be avoided by a careful, sensitive analysis of 
the effects of implementing new systems, in some cases, there will still be 
negative impacts; but ,f they are anticipated, formal organizational charge 
management can be undertaken to introduce the new situations in a positive light. 

Fortunately, there are many positive inpacts, both anticipated and unanticipated, 
liiich result from the ^reduction of new information technology. One major 
computer vendor found that a video conferencing facility, built to serve internal 
meeting functions, turiied o.t to be a powerful marketing tool on the day it w^ 
used to put a client in touch with a key engineer at a ramof site in a matter of 
minutes. No one had investigated the benefits of using the conferencing facility 
in this way when it had been proposed and its cost justified. This one success- 
ful sale went a long way tov'^rd paying for the facility! 

Another example of iranticipated inpacts can be foind in the bank that inple- 
mented a decision support system to help their stock analyses model portfolios. 
The system was justified on its ability to perfonn quickly the tedious operations 
of getting the raw data, graphing the results and butlding various versions of 
portfolios. However, two of the most significant impacts were totally unfore- 
seen. First, the customers who saw their analysts using the system were so 
impressed that they resolved to maintain their accounts there, to invest more, 
and to "tell their friends." Second, the analysts became so accustomed to using 
the DSS that they dich't want to leave the bank unless they could be assured of 
getting a similar -/stem elsewhere. Clearly, there were desirable marketing and 
employee relation s impacts in this case which were not planned. 

The popular press has reported in the past that one form of information tech- 
nology, office automation, will have negative impacts ranging from job tediun to 
illness resulting from long sessions at the keyboard. Nost of the illness claims 
have not been sii)8tantiated. It is a fact, however, that infommtion technology 
can be inplemented in ways which will "deskill" workers' jobs. This is not a 
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result of the technology, but rather a result of how someone has implmnted the 
technolog/. kn^ technology can be used in bad uays. It Is up to manageifient to 
plan the use the technology in positive ways, and to be sensitive to any 
Misuse and unforef^en effects. 

These exMples have damonstrated a variety of inpacts of information technology 
on organizational structure and politics, organizational strategy, and prodjc- 
tlvity. 

The key issue ia careful planning and sensitive analysis of the infomation 
technology in the 1av>lcaientation plan. In addition, it is important to continue 
■onitorir^ the use and success or failure of information technology after It haa 
become operational. Often, unanticipated inpacts, both positive and negative, 
can be managed after implementation. 



Uhat does all this tell us about the information systems of the future? Clesrly 
there will continue to be challenging problems in both the technical and 
organizational arenas. Moreover, since innovation tends to emerge from actual 
use and users are u^edictably creative, the exact directions of information 
technology development are unknown. 

Technical Challetws. As more people become proficient users of information 
technology, the demands on the information technology support systems increase. 
Data resource management has already been identified as a key problem area. With 
many users in mp~/ diverse departments seeking information from corporate 
"files," all the age-old problems of data definitions, accuracy, standards, and 
conaistency take on a renewed inportance. Miile the majority of the users have 
been middle* level managers, the problems have often been ignored or tenporarily 
fixed. However, as top management and even CEOs begin to become regular users of 
information technology, the problems will have to be solved. 

In a recent study performed by CISR, we found an increasing nmtoer of top-level 
managers beginnirv to use personal computers and terminals. In the process of 
providing this tool, data processing departments were discovering numerous 
problems in corporate data files in the areas of accuracy, consistericy, and the 
ability of the data to be accessed. As a result, much of the informstion 
necessary to seaport top management's use of such a system had to be recreated 
through tedious re-keying of the basic data- There is clearly a limit to the 
maount of this sort of "petching" that can be efficiently undertaken. 

The technology infrastructure to st|)port wide-scale use m&^. be in place. This 
includes communications capabiliti^ as well as hardware and software compatibil- 
ity planning, r'jmeone needa to be responaible for managing information tech- 
nology at an organization- wide level in order to solve these problems. A few 
years back the notion of the CIO •• Chief Information Officer -- was introduced. 
The concept is that, j«^t as other resources (e.g. money) need a top management 
watchdog (e.g. the Chief Financial Officer), information ia a major resource and 
needs to be managed at the top levels of the organization. 

Since the advent of the personal computer, the image of information technology 
work is that of an individual teamed with his/her PC grinding away at daily 
tasks. Indeed users often start out working in an independent mode. However, 
viry quickly the need to seek information either through incfjiry into a computer 
data baae or inquiry into a "hunan odta base" (asking someone) becomes an 
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iMportant atpact of the work. As conmunl cat Ions netuorks are avallaKe, the 
huMm dnta base Inquiry is accompUshad via electronic conmuni cations. 

Tha resultant need to tie Individual users to data and to other users is the 
drivirv force behind the telecoamuni cations challenoes today. Uhether the links 
■ust be Mds within a building, a city or throughout the globe, a major design 
and i^plSMntation of the teleccanunications infrastructure rontinues to be a 
tf^-tmological challenge. 

Organiiatfonal Challenges, In addition to the political problems discussed 
earlier, which will remain until adequately managed, organizational challenges 
will increase in the areas of education and changing management skills and roles. 
Education has consistently been a difficult area because users uho need informa- 
tion technology to help them ususlly do not have the time to learn properly how 
to use the technology. It has also taken quite a while for education programs to 
be specifically designed for the upper level manager. 

Early "educatior^ programs were generally simply training sessions where users 
were tau^t basic mechanical skills. These programs were not necessarily 
developed by people who knew anything about training or education; often they 
were put together by knowledgeable technicians. As a result, sifsport staff were 
poorly trained to use systems, and no one dared to expose management level 
personnel to such programs. Happily, typical of American entrepreneurship, many 
organizations have spnng up to fill this education gap. Opportunities are now 
available for quality education in information technology use. 

Even as education progrmaa play ••catch up," they are continually dropping behind 
as managers* technical skills Improve. In addition, managerial users are 
experiencing significant role changes with the advent of information technology. 
Line managers who have never used information technology are finding they have to 
manage people who do. We are also seeing decentralization of many formerly 
centralized information systems, which brings information systems management 
tasks to line managers who are inexperienced with systems. 

All this means that organizatf^ iust be prepared for investing time and 
financial resources into continual education ranging from basic technology lise to 
higher level management skills. 

S»/atems of the Future. Predicting the future is something many would like to be 
able to do. At moat we can suggest directions based on th^ ways in which people 
work, on technology development, and on what people say they want to do. 

The moat significant aspect of the way people work, which is just emerging as a 
direction-setting factor, is the notion of groip work. The personal computer and 
its sssociated software were designed with the image of a single person working 
on a taak and using tools to help him/her solve problems. The breakthrough 
software in personal computing was VisiColc, a spread sheet tool that helpa an 
individual do independent analysis and ••whai; iffing.^* Most of the tools which 
followed were al&o designed with the single user in mincf. However, when we look 
at the work getting accosplished in organizationc, in many instances it is 
actually being done by a groi^: a task force, a project team, a collaborative 
writing effort, etc. Even wh'^n the task is being solved independently, at some 
point it is coonuiicated to others in a formal presertation or written report. 

A new research interest is emerging today -- variously called collaborative work, 
coa|)uter*sif)ported groups, group work which focusses on the rnic^ aspects of 
supporting a task when it is being performed by more than one person. This 
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includes both synchronous and asynchronous work, e.g. both meetings and indepen- 
dent tasks as part of group work. Ue can expect neu information technology in 
this arena. 

Some of the new directions for information technology are continuations of what 
have always been new directions: more power, less cost, huiian factor engineer- 
ing. In this last category, researchers are still looking at way. to help people 
interact with computers without using keyboards. In addition, rn^yrh progress has 
been maae to make new software packoges self-evident, eliminating fonna training 
classes to a certain extent. Progress is always being made; howevtr, total 
solutions are yet to be found. 

networking will certainly be an important part of future systems, m the sane 
way that the telephone became a universal mode for cofimunica^'lon, computer 
networking is growing in that direction. However, since standardization was not 
created through regulation, as it was for the telephone, many problems exist in 
interconnection and reliability. 

Some of the technological advances discussed above also respond to what people 
have said they would like to do. Users want systems that are easy to learn and 
use, thereby avoiding the investment of time involved whenever something new 
ccMes along. Users want information hardware that is as unobtrusive on their 
desks as a telephone and just as **natural« to use. Users want to be able to send 
an electronic message to an/one in the s^ way a paper letter can be mailed to 
anyone. At the same time, users want to be able to control the amount of 
electronic mail they receive, i.e. set priorities for incoming mail and eliminate 
junk mai I . 

Oie of the most promising areas of research for future systems is the application 
of expert systems tools to the design of systemr. Because the concept of 
knowledge engineering supports the notion of carefully understanding the task and 
the way the ^expert" performs the task, this is one tool which goes a lor« way 
toward making systems relevant. 

In the end, thf* challengu-s of the future remain the same as those of today: 
designinn information technology to support the tasks being performed, it is by 
better understanding the work and making the tools easier to learn and to use 
that we will t.iake future systems better. 
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ASSESSMENT, ACCREDITATION, AND INSTITUTIONAL 
EFFECTIVENESS: IMPLICATIONS FOR OUR PROFESSION 
(presidential session) 

Donald J. Reichard, 1986-87 AIR President 
Director, Institutional Research 
University of North Carolina-Greensboro 

Theodore J. Marchese, Vice President 
American Association for Higher Education 
and Executive Editor, Change Magazine 

(This is an edited record of a session held in the Count Basie Ballroom of the 
Vista International Hotel, Kansas City, No., on Wednesday morning, Nay 6, 1987.) 

Reichard: 

During the early days of my term as president, I tried to 
decide khether the traditional presidential address was an 
honor or an obligation -- a necessity in order to convey the 
state of health of the Association and the art of our craft as 
institutional researchers or, perhaps, an anachronistic 
expectation to which there might be some reasonable alterna- 
tive. 

As one is prone to do under such circvmstances, I turned for 
guidarice to the addresses of my predecessors published in prior 
Forum Proceedings. The voices of 21 predecessors spoke with something less than 
total unanimity. On the one hand, the membership's expectations for the presi- 
dent's address were high. On the other hand, the realistic presidents' assess- 
ments of what they were likely to accomplish were somewhat more modest. 

Meeting in Denver in 1982, Bill Tetlow described the membership's expectaticns as 
threefold: to assess the state of the art of institutional research, to examine 
the future, and to inspire the meirbership. Recognizing the difficulty of 
achieving all these objectives. Bill added that he would be quite content if his 
performance could be compared favorably with that of the cross-eyed Javelin 
thrower who did not win many medals, but definitely kept everyone alert. 

At the first AIR Forum I attended, also in Denver, in 1971, Sidhey Suslow was 
less sanguine about what could be accomplished through the presidential address. 
He concluded that ''presidential addresses once spoken are never read, and once 
read are never reiimrfiered.*' Bill and Sid have succeeded in lowering my expecta- 
tions to the point that if, in five years, the membership forgets in whose term 
of off ice this session and related special Forum sessions were held but remmrbers 
and is more involved in the SL'bstantive area I have asked Ted Narchese to assist 
me in emphasizing, I will not be disappointed. 

Today, I intend to depart somewhat from the format for presidential addresses 
adopted when the Association was formed. As Marilyn NcCoy and Narv Peterson have 
done the past two years, I shall team with others in order to bring added 
.^asis to an area which we as an Association must address. I do not intend to 
evaluate the state of the art of institutional research or the health of the 
Association. Rather, I wish to draw attention to the substantive area of 
assessment, accreditation, and institutional effectiveness and to the oppor- 
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tunities involvement in these areas hold for us as institutional researchers and 
as an Association. 

The area is not a new one for us. Institutional researchers have labored in the 
assessment and evaluation vineyards for years, as evidenced t3y Paul Dressel's 
1958 book on Evaluation in the Basic College at Nichigan State. The titles of 
earlier Forun Proceedings attest to the focus of institutional research orienta- 
tions in prior years. The 1966 Forun Proceedings containing the first presiden- 
tial address by John Stecklein were entitled "Research on Academic Input." The 
1967 and 1968 Proceedings were entitled, respectively "The Instructional Process 
and Institutional Research" and "Institutional Research and Academic Outcomes." 
Joe Saipe>s presidential address, "Assessing Program Quality," would be as timely 
now as when it was delivered exactly 18 years ago today at the 1969 Forun in 
Chicago. Indeed, I was greatly tenpted to deliver Joe*s address unchanged to see 
if anyone other than Joe would know. 

Although present discourse on the themes of assessment, accreditation, and 
institutional effectiveness may sound familiar to long-time institutional 
researchers, the area has received less attention in recent years and the themes 
uhich ar£ emerging come from several divergent and occasionally convergent 
streams of thinking, writing, and actions. In my letter of some months ago to 
Ted, I asked him, as a most knowledgeable observer of the current scene, to 
attempt to sort out hi}w these themes have emerged in the nation's current dis- 
course about higher education at the federal, regional, state, and institutional 
levels. A second focus for this and the other related sessions is to explore the 
inplications of involvement in assessment for the practice of institutional 
research by those who actually carry formal institutional research titles and 
those uho are functionally involved in institutional research within other 
offices the ever-elusive "invisible institutional researchers." 

Some Definitions 

Assessment . To provide some background and comnon terminology for those who have 
not been immersed in the area, I would note that assessment activities defy any 
simple characterization. At a limited nunber of private institut;uns such as 
Alverno College, assessment focuses \pon feedback and the achievcm^nt of learning 
objectives. At the state level, enfihasis is sometimes placed f4>on the demon- 
stration of minimum conpetencies in order to provide a line of passage between 
high school and college or between sophomore and junior starding in college. 
Still other state- level assessment efforts, as in Tennessee, focus upon "value- 
added** in partial response to financial incentives provided by legislatures or 
state coordinating agencies. A third form of assessment, going back more than 30 
years to the foundation of institutional research activities, is program evalu- 
ation and the evaluation of outcomes, pioneered in the General or Basic Colleges 
at the University of Minnesota and at Michigan State. In this sense, the theme 
of this session could be subtitled "IR Come Home." 

Accreditation . Accreditation processes emphasize the assessment of individual 
learning as well as institutional outcomes. In the last two or three years, 
adoption of the Southern Association .or Colleges and Schools (SACS) Criteria for 
Accreditation , especially Section III on Institutional Effectiveness, has focused 
attention on the need for institutions to demonstrate the existence of and 
evaluate ongoing planning, evaluation, and institutional research functions. The 
Criteria have been referred to by some wags as "The Full Employment Act for 
Institutional Researchers." The existence of regional accreditation criteria 
requiring institutions to evaluate themselves in relation to their stated 
purposes is not new. The demonstration of an ongoing commitment of resources to 
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assure that institutional research and planning processes are continuous rather 
than cyclical in nature places an obligation upon professional organizations such 
as AIR to assist colleges and universities In defining and evaluating such 
processes. Will similar criteria spread to other regional accrediting associa- 
tions? Uhat developments relating to assessment wight be expected to emerge 
through changing emphases within the various accrediting agencies? Stay tuned. 

Institutional Effectivengss . Attempts to define the term Institutional effec" 
tiveness are diverse and perhaps rami ni seer.* of efforts some 20 years ago to 
define institutional vitality. More recently, the Review of Higher Education 's 
Special Issue on Institutional Effectiveness (Volume 9, No. 1, 1985), edited by 
Kim Cameron and ^llen Chaffee, has contributed to such discussions. To some, the 
call for institutional effectiveness is a cry for more effective leadership. The 
SACS criteria on Institutional effectiveness are In the process of being defined. 
NCHEHS is offering seminars on institutional effectiveness. Clearly, there are a 
lot of mixed messages and varied reference points associated with the tern 
institutional effectiveness. Identifying which dimensions 9f the term have 
particular currency and significance for institutional researchers is of special 
interest to our meirbership. 

Importance of the Topic 

This year, Forun Chair Gerry McLaughlin has been especially generous In 
allocating additional time periods to develop the special emphasis upon Assess- 
ment, Accreditation, and Institutional Effectiveness. On the heels of this 
session will be a follow-up seminar chaired by Richard I. Miller which will also 
involve Peter Ewell of NCHEMS and Ted Marchese. Later this afternoon, there will 
be a panel on accreditation moderated by Peter Ewell and a panel entitled **State- 
Level Initiatives in Assessment: Why and How?** chaired by Jim Mingle, Executive 
Director of the State Higher Education Executive Officers (SHEEO). Earlier this 
week, a special hearing was neld to learn how AIR*s various committees were 
working together to address coninon concerns and Issues in this area. 

Why this particular enphasis at this time? Because it is the right time for our 
institutions and for AIR as a professional organization to focus their energies 
in these areas. 

For institutions, the topic of this session has currency not only from an 
institution's desire to formulate assessment strategies In response to Internal 
priorities, but also because of an Increasing array of external mandates. The 
focus upon accreditation and institutional effectiveness has been especially 
strong in the South due to the Institutional Effectiveness criterion contained In 
the Criteria for Accreditation adopted by the Southern Association of Colleges 
and Schools (SACS) in 1984. 

The Institutional Effectiveness criterion of the SACS Criteria states that each 
institution must: 

. define expected educational results and describe how these results will be 
ascertained 

• engage in continuing study, analysis, and appraisal of the purposes, 
policies, procedures, and programs 

The Criterion contains a specific sub-section on planning and evaluation. It 
also contains a sub^section on institutional research which concludes by stating 
that "Institutions must regularly evaluate the institutional research function.** 





The Criterion does not prescribe the methods of assessing effectiveness nor does 
it prescribe levels of achievement in any area. 

H.R. KellSf Professor of Higher Education and Information Systems at Rutgers 
University, is a long-time influential participant, author, and observer of the 
accreditation process, as well as a charter member of AIR. He predicts that 
"Because of its national leadership in enacting the Criterion, SACS will also 
have an effect on all U.S. accrediting and, through it, all U.S. higher education 
institutions." it is evident, Kells notes, that "SACS means to proceed with a 
healthy focus on continuous assessment and planning and a complementary or 
constituent emphasis upon results or 'outcomes'." He observes that the new 
Criterion will require changes in how we study ourselves, in our institutional 
research capacities, and in the priorities of this study capacity and the data 
bases on uhich they are built. If we are to respond to the mandate to look 
increasingly and regularly at results, it will mean a reordering of priorities 
and investment in staff and systems. It also must mean collaboration, sharing, 
and joint development if we are to achieve the needed systems and efforts. Kells 
concluded, "Even if we take ten years to build the capacity to desired levels, we 
must do it." 

ImcUcations for the Association for institutional Research 

If the topic of this session is timely for our institutions, I would suggest that 
the time is also right for the Association to address the issues of assessment, 
accreditation, and institutional effectiveness, in doing so, we would be in line 
with several of the recomuendations made by The Commission to Reassess the 
Purposes and Objectives cf the Association and the paths of action which are 
emerging from our agenda-setting activities of the past two years. 

Commissio n to Reassess the Purposes and Objectives of the Association. As many 
of you know, this task force was appointed by President Bill Lasher in 1982 and 
was asked to submit a report to President Sam Adams by the time of the 1984 Forum 
in Fort Worth. It was my privilege to chair the 12-meirber Commission, which made 
10 recommendations. As I was not a member of the Executive Committee in 1984-85, 
it ^as my good fortune to pass on to Marv Peterson and Marilyn McCoy the primary 
responsibility for inplementing the Corrmissioo's recommendations. Needless to 
say Marv, Marilyn, and their Executive Committees did a marvelous job. 

I believe that further Association emphasis upon issues and concerns related to 
assessment, accreditation, and institutional effectiveness may speak, in part, to 
several of the Commission's recommendations which are still in the process of 
being redefined. Two illustrations may suffice. 

First, the Commission and subsequent Executive Committees were concerned with 
increasing the visibility of the profession and the Association within postsec- 
ondary education. An enhanced visibility was seen as a prerequisite to increas- 
ing membership in the Association. Because in the United States, for exanple, 
only 998 of the 3,455 postsecondary institutions have individuals who are 
currently AIR members, the Executive Committee encouraged promotional efforts 
that provide a broader image for and understanding of institutional research. 

Uppermost in the minds of the Executive Coninittee was the development of strate- 
gies to encourage membership by individuals who are: (1) not in traditional IR 
offices, but are involved in institutional research in functional areas such as 
planning and policy analysis, academic affairs, student affairs, budget and 
finance, governmental relations and development; (2) from underrepresented 
institutions, such as liberal arts colleges, community colleges and non-tn«di- 
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tional postsecondary institutions, or (3) from system, state agency, consortia, 
associations, or research offices with an Interest in research and analysis. If 
this Association establishes itself as thg professional organization uhere the 
most productive dialogues with regard to the development, testing, and implemen- 
tation of methodologies and strategies for addressing assessment, accreditation, 
and institutional effectiveness takes place, the universality of these concerns 
will surely encourage broader participation in AIR. 

In my view, the Association is uniquely positioned to attract a greater degree of 
interest from "invisible Institutional researchers" In the area of academic 
affairs. Indeed, we already do serve the area of academic affairs in part. If we 
can believe the findings of a 1981 Professional Development Services Board survey 
which indicated that 25 percent of our single-campus based menbers are currently 
employed in offices reporting to a vice-president for academic affairs. Our 
publications, especially New Directions for Institutional Research , monographs 
such as Peter Ewell's Assessing Educational Outcomes , and several recent issues 
the Professional File series, have placed heavy emphasis upon assessment 
related concerns. A quick leafing through this Fonm's program would show more 
than two dozen sessions, panel, and seminar session that would appeal to 
individjals coming to the Forum with a specific interest in assessment, 
accreditation, and institutional effectiveness issues. 

Increased efforts to market specific sets of Forun sessions to specific target 
groups or to develop position round tables may be helpful. The panel at this 
Forum on "Institutional Research for Academic Affairs" and the contributed paper 
on "The Role, Scope, and Functions of the Chief Academic Officer" may be steps in 
the right direction. In pursuing such organizational alms, more creative 
thinking needs to be done. 

A second area addressed by the Commission was that of "Promoting the Use and 
Understanding of Institutional Researc»-." The Commission's recomnendation stated 
that "The Executive Committee should establish a special task force to develop 
specific objectives and appropriate structures for encouraging political, 
administrative, accrediting, professional, and/or research organizations to 
utilize institutional research, policy research, and analysis techniques through 
the expertise of the Association and its membership." 

One obvious application of this recommendation is establishing an enhanced 
working relationship with the Center for Education Statistics to provide Ir^t on 
the IPEDS implementation process, a subject addressed at our Annual Business 
meeting within the last hour. Another area of application is implementation of 
the SACS Criterion on Institutional Effectiveness. 

The Association should Le very concerned that its members play an Inportant role 
in determining how such Criteria should be implemented, for in doing so, we are 
defining uhat the very nature of institutional research activity Is and ought to 
be. Indeed, I am heartened that each of the three primary presenters at tomor- 
row's Post-Forum Professional Development Opportunity workshop on ^'Approaches to 
implementing Institutional Effectiveness," organized by Jim Nichols, are AIR 
menbers who have served on an important SACS committee charged with developing 
the just-completed draft Manual on Institutional Effectiveness. Others within 
the Association, including myself, have been Involved as reviewers of the draft 
Manual and/or as members of SACS visitation teams. We need to promote more of 
these types of involvements in the future. 

Agenda -Set ting. The Association embarked on active assessment of trends and 
issues in higher education as a first step In identifv^ng major Issues to be 
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addressed on a continuing basis through the Association's programs and services. 
Last sunmer, Marilyn NcCoy conducted a survey of approximately 200 higher 
education opinion leaders. Results were conveyed to members of the Executive 
Connlttee, Publications Board, and Professional Development Services Board in 
advance of their joint meeting held in Chicago in early October. (See *'AIR 
Agenda-Setting Survey of Higher Edtjcation Experts, Septesber, 1986.) Also as 
background for the Chicago meeting, Vice-President Laura Saunders prepared an 
analysis of the substantive areas addressed through AIR Forum sessions. New 
Directions for Institutional Research monographs, and articles appearing in 
Research in Higher Education for the period 1984-1986. When combined with an 
earlier analysis of Forum content and NDIR monographs content prepared by Craig 
Johnson for the period 1979*1983, these materials constitute a valuable resource, 
charting the substantive development of institutional research as a profession. 

Given the focus of this session, it should not surprise you if I told you that 
264 of 724 (36X) of the issues identified in our agenda -setting survey of higher 
education opinion leaders were related to academic and faculty issues. Within 
this response category, the two most frequently cited issues were: 1) under- 
graduate teaching and learning, and 2) educational quality and assessment. 
Student issues constituted 136 of 724 responses (19X). Within this category, 
ability and acce&s Issues and demographic concerns were cited most frequently. 

You will undoubtedly be hearing more about the agenda- setting process and 
activities which Marilyn McCoy Initiated last /ear and Laura Sainders will carry 
forward In the year ahead. An open hearing on agenda setting is scheduled for 
this afternoon. 

Let me sunmarize by reemphasizing that today's orientations in the assessment, 
accreditation, and Institutional effectiveness areas represent a conplex mosaic 
that conveys mixed messages to our Association. Are we concerned with setting 
admission standards, assessing individual learning outcomes, program outcomes, or 
institutional outcomes? Who is doing the assessing? How should assessments be 
conducted? What are the roles of AIR members in this process? What do NCHEMS 
and SACS mean b/ the term institutional effectiveness? To sort some of these 
concerns out, we are fortunate to have an individual with us who is a former 
Institutional researcher and Is currently at the forefront, nationally, of 
developments in the area of assessment. 

Ted Marchese was born and raised In New Jersey and holds a bachelor'^ degree in 
English llter'^^ure from Rutgers University, a law degree from Georgetown Univer- 
sity, and a Ph.D. in higher education from the University of Michigan. 

He began work in Washington, D.C., as a staff aide to U.S. Senator Clifford P. 
Case (1960-61), served on the early Peace Corps staff 0962} , then worked at the 
American Council on Education as assistant director of its Commission on Academic 
Affairs (1963-65). 

Following doctoral work at Michigan, Marchese spent 14 years at Barat College in 
Lake Forest, Illinois. As a faculty member, he taught statistics, social 
research, and the law of crimes. Our 1976-77 through 1979*80 AIR membership 
directories list Ted as Director of Institutional Research. Other administrative 
assignments included planning, government relations, accreditation, and various 
forms of project work. From 1979-82, he served as Vice President for Administra- 
tion at the College. 

At AAHE, Marchese's responsibilities since 1982 have been In the areas of 
publications and conference management. He edits the AAHE Bulletin and is 
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executive editor of Chang e niagazlne. He has tracked the assessment issue for 
AAHE since 1985, and organized, with NIE support, the first National Conference 
on Assessment In Higher Education that fall. AAHE has since become a center 
point for Information about^ assessment; In my own attendance at three national 
conferences on assessment In the last year, Ted Narchese has been the lynchpin. 
He has addressed a doz'^n state and national conferences on the topic in the past 
year. 

AAHE*s latest venture Is the AAHE Assessment Forun, a three-year, FIPSE- supported 
project of meetings, field reporting, and Information sharing. The Fonm will 
mount a second National Conference on Assessment June 14-17, 1987 In Denver, with 
a focus on campus Implementation. 

Ted, It's yours. 

Marchese: 

In response to Don Reichard*s charge, I plan four things In 
these remarks. First, I want to talk about the emergence of 
assessment as an issue, and ask whether it Is a fad, then what 
Its residue of meaning will be for our Institutions. Second, I 
want to look Inside this thing called "assessment" at the 
variety of things parading under its banner and ask, 'lUhat are 
Its assunptlons?" Third, I want to look briefly at the history 
and character of Institutional research, as Don has done, and 
ask about IR's relationship to the phenomenon of assessment and 
to assessment's spin-offs in Institutional accreditation. 
Fourth, I have several recommendations to you as colleagues who 
do institutional research and are worried about assessment. 
Let me begin right off with the first of these four questions, that of assess- 
ment's meaning as an issue. 

In the largest sense, assessment is where the quality debate In higher education 
wound UP* The quality debate Is in about its third year. I think it may have 
two or three more years to run, the way these things come onto the stage and go 
off; so, indeed, the quality debate may be half over. The question, then. Is 
what's going to be left behind. I think assessment Is one of the things that 
will be left behind. The Issue to me is, '*Ulll the assessment that Is left 
behind have any impact on quality?" 

The debate about quality in higher education was triggered in part by a series of 
recent nation- ' reports. These are too familiar to you to review here, but I 
want to acknow Kige a persor. who has been on this platform many times, Alexander 
Astin, whose book. Achieving Educational Excellence , and role in the preparation 
of the NIE report have been very Influential In the evoU''<:1on of our senr^ of 
what quality means. What you find in the NIE report (and <n the AAC report) Is a 
new feature In the discourse about quality In hlgb^r education, the Idea that 
quality should be judged not on the basis of reputatlonal rankings or on the 
basis of resources -- so called Inputs *- but on the basis of contributions made 
tc student learning, the "outcomes" we bring forth in students. 

You all know that this is far from a new view; yet It Is one with profound 
Implications. It inplies, among other things, the doing of assessment, that we 
know more about our contributions to student learning, that we it our eyes 
systematically on the effects of teaching and learning and of programs. What's 
new Is not the Idea of outcomes; that's been in our textbooks a long time. What 
is significant is that in the past year there seems to have been a shift in the 
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way a broad spectrun of people now talk about quality in higher education; the 
notion that outcomes should be a chief indicator of quality seems to have taken 
hold. The recent book by Derek Bok, Higher Leamino . and Ernest Boyer's College 
both presumed such an outlook. The assessment of studp-it learning and institu- 
tional effectiveness seems to have become part of tlie way people both within 
higher edjcation and outside of higher education think about quality. That is an 
historic shift with profound iirplications. 

The debate about quality and its mean ng has played itself out in many quarters, 
not the least of which is within our own mechanlsmp of voluntary accreditation. 
Those mechanism, especially those of regional accreditation, are weak and held in 
low regard. What you will hear when you talk with colleagues on canpus and 
people in state houses is that vol;jr>tary accreditation "doesn't do that much to 
promote improvement or to curb abuse." There is a big tendency today to "write 
off" accreditatic ). 

A notable phenomenon of the past two years has been the way accrediting agencies 
have seized on outcomes as a new handle for potential influence- The Southern 
Association of Colleges and Schools got a lot of publicity a couple of years ago 
by enacting a new criterion requiring "evidence of effectiveness" in all institu- 
tional reviews. "We had that all along," many of the other regionals said, and 
indeed they did. But where was it? Honored in the breach, as they say. I 
personally doubt that even a new focus on cutcomes can revivify regional accredi- 
tation or that its new or ckjsted-rff standards will greatly affect institutional 
conduct. 

Where we will feel an affect from a new focus on outcomes will be through 
specialized accreditation. Specialized accreditation is going to move inexorably 
to an outcomes approach because of internal dynamics but also from external 
pressure from the National Advisory Committee on Accreditation and Institutional 
Eligibility (NACAIE), the U.S. Department of Education body that "recognizes" 
accrediting agencies for purposes of triggering institutional ability to handle 
federal money (a very important lever). NACAIE has already reconmended, and the 
Secretary of Eckjcation will probably endorse, a requirement that any accrediting 
association, in order to be on the secretary's eligibility list, must have 
outcomes as its primary basis for program approval. That will make a difference 
to our institutions, because these specialized accreditors do have clout. They 
will be the chief bearers of outcomes assessment onto our cairpuses. 

Let me return to assessment, its momentum comes not primarily from our internal 
debates, national reports, or regional accreditation, but from an external 
quarter: the states. We've had a remarkable string of bright, aggressive 
governors Ajring this decade; I refer to Governors Alexander. Kean, Babbitt, 
Ashcroft and Clinton, who have driven programs of educational reform at both the 
IC-12 level and the postsecondary level. They built those programs aroifxi 
education's potential to build a competitive work force. What's on the minds of 
these governors is jobs. They want a more talented work force for job creation 
and economic growth, and to get that they want student performance tr be at 
higher levels, implying that schools and colleges must perform at higher levels, 
and to get that they want assessment, which they see as a way to monitor and 
prompt improvements in quality. We saw a phenomenon of state-mandated "assess- 
ment" earlier in the schools (defined as statewide standardized testing); in 
1985, Colorado became the 50th and final state to mandate statewide tests at the 
K-12 level 

Now we've begun tc ? & spillover into the postsecondary level. The first 
states, in the early *tOs, tended to mandate top-down, statewide prograns- You 
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know the familiar stories of what is happening in Florida, Georgia, Tennessee, 
South Dakota, and New Jersey. Beginning in about 1985, there was an outcry 
against broadscale, test-driven state mandates (led in significant part by AAH'^). 

A newer pattern has emerged during the past year, and that is to abjure a single, 
statewide approach and rather to ask or demand that institutions come forward 
with individual plans. This is the pattern that we see unfolding in Virginia, 
Connecticut, Colorado, end a nuiixr of other states. Another key fact is that a 
year or two ago we might have been talking about six to eight states that were 
doing something in the name assessment; now we are looking at about 35 states. 

At the state level, this movement has been fueled by reports from the National 
Governors Association and the Education Commission of the States. The 
interesting thing to me is the questions these gubernatorial bodies are asking of 
higher education. What the governors are asking is, "Do your curricula add up to 
the performance we need?" How do you know? Do your graduates know and can they 
do what your degrees imply? How do you know they do? 

Several comments seem apt. First, these are reasonable questions. We should be 
able to answer them; at some point we will be professionally enbarrassed not to 
be able to do so. They are really the same questions, although in different 
language, that we have been asking ourselves in our own reform movements. 

A second perspective is that governors and legislators don't start with the view 
viiat conditions are terrible in higher education (as some state enactments 
directed at high schools have presumed). They sense, by and large, that we are 
doing a good job most of the time with most of our students. But they think we 
are so inportant to an abler, more conpetitive work force that we need to be 
called to even higher levels of institutional and student performance. 

Third, by and large the subject-matter competence of our graduates is not at 
issue. People are not saying, "Your chemistry graduates don't know chemistry." 
(The one exception is teacher education.) Rather, the unease has more to do with 
the general qualities of our graduates, their abilities to think, to write, to 
create, to work with others, to solve problems all the things that are 
supposed to be part of the higher* order abilities people expect in a college 
graduate. 

Fourth, when you look more deeply into the present state of knowledge about how 
to do assessment especially assessment that does more than docunent quality, 
i.e. improves quality -* you find a pretty bare cupboard. There are a handful of 
institutional examples, but little basic research, little evaluation, and quite a 
small professional community engaged with the issue. There's little in the way 
of imminent new funding, nor is there much to learn from the iC-12 experience. 
You can get discouraged about all this, yet we are a lot further along today than 
we were 12 months ago with a knowledge base for post secondary assessment. Even 
so, a lot of the claims being pushed by policy makers are coming at us on the 
basis of a knowledge base that remains thin. 

One last thing- some of the best knowledge we have about the doing of assessment 
and its effects is not contemporaneous but is from earlier decades. It was done 
by people who were founders of the work that came later to be known as institu- 
tional research. But as I look today across the small professional community 
working in assessment, I find very few IR people in the lead ranks. 

The second main section of my remarks looks inside the black box to ask, "What is 
this thing called assessment? What's going on in its name?" My answer is that 
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assessment i*} no one thing. What we see today is a series of different lines or 
traditions of work, five in all, to uhich we can look as a source for ideas. 

Tlie first tradition or relevant line of work is that of assessment as an adjunct 
to pedagop . This grew out of a process known as the assessment -center method. 
You all know that the ^208 and '30s were the great era of standardized testing. 
This proud new tool of the psychologists promised an inexpensive, easily grasped, 
and scientific way of screening and selecting people, whether for a college or 
for a job. (The SAT began in 1926, for example.) In the late '30s there was a 
reaction against testing among acadefiiics in the United States, England, and 
Germany; they argued that human performance was too conplex a phenomenon to gauge 
with paper and pencil tests alone, that ff you wanted to select people for 
something, you had to look to their demonstrable abilities to perform. Since 
there were observable aspects of performance, they urged creating conditions 
under uhich a candidate's performance could be observed and judged. 

That was the theory; the big trial came in 1940. The British army had a problem. 
It needed thousands of new officers, and there were not enough people with the 
old college ties to pick the trainees that way. So they set yp > process in 
uhich the backgrounds of candidates were looked at carefully; they were exten* 
sively interviewed: they were indeed given some tests; but the centerpiece was a 
set of contrived performance situations in which candidates, for example, had to 
irrprovise an escape, give a morale speech and so on. These performances were 
judged by trained observers; then all these sanples of performances were pooled 
and judged again by trained experts, and then people were selected or not on the 
basis of those judgments. 

It seemed to be a successful and more rational, powerful way of selecting people. 
And so our OSS used it during the World War II beginning in 1943, to select 
spies. A bcok was published about the OSS experience called The Assessment of 
Men, in 1949; It claimed performance -assessment was a b\j success. In 1954, a 
man named Douglas Bray set up an "assessment center" at ATAT. The corporation 
recruited thousands of new employees every year, and its problem was familiar: 
how do you select the people that should go forward for management training? The 
very good thing they did was to put in place a longitudinal research component. 
As the results came out, they were very suggestive and positive. Other corpora- 
tions were impressed and the use of assessment 'center technologies for managerial 
selection became comnonplace in the '60s in business, industry and government, 
with notable assessment centers at IBM, SOHIO, Sears, and J.C. Penney. The tools 
of these assess«iient centers are \iost tne same today as those used by the 
British Army in 1940; the "inbasket" is the major new thir^ added since and even 
that is now 35 or more years old. 

In the late '608 and early '70s the interest of educators, mostly faculty 
members, was drawn to this work. But the educators' questions were different: 
it was not a matter of how to identify and select competent people, but how to 
develop and educate competent people. They wanted to educate for "effective 
performance." So they added to the industrial model an old educators' concept; 
feedback to the learner. They didn't want just to docimcnt abilities for the 
purposes of selection; they wanted to improve those abilities. They wanted to 
understand components of performance at a deeper level and educate for them. 
Therefore, they didn't see assessment as a one-time, stand-alone event. They saw 
it as part of the teaching process one does over time. What the new assessors in 
education also saw was that assessment forces one to cx^in with explicit state- 
ments of desired outcomes, then that these must be ptr>red back into individual 
classrooms and programs. There, teachers must set clear and high expectations 
built around those outcomes, involve students in tasks relevant to those out* 



36 





comeSi and advance student growth with the help of continuoua feedback. Sounds 
like t*:e NIE formula, doesn't it? "Involve students in their learning, set high 
expectations, assess and provide feeddack**... that's a good sunnary of the NIE 
report, l-"^ ^lvement in Learning . 

At the cU. Km level, assessment becomes a powerful adjurKt to pedagogy aimed 
squarely at .iiproving student performance. Where is this going on? The answer 
is, not too many places. At the institution-wide level there is Alvemo College. 
But most of what goes on happens within individual programs. The best exanples 
arise in medical education, nursing education, architecture, and so on, mostly in 
programs of professional education in large universities. 

There is a research literature that has grown 14) about all of this. I think that 
most of you would be familiar with Donald Schon's work on components of profes- 
sional effectiveness and on the learning-doing nexus. There have been very 
important evaluation studies done at Alvemo. Ue also have the McSer studies on 
teachable abilities and, back in the corporate sector, the Center for leadership 
Development in i^orth Carolina has done studies on the teachability of managerial 
effectiveness. (The answer is lots of these abilities are teachable.) 

Let me recapitulate the premises of this approach to assessment. Assessment 
center people begin always with aii eye on an intended future performance, on an 
outcome; whether you want the person to be a spy or an architect, you've got to 
be very clear about what you are selecting or educating the caiXlidate for. 
Secondly, there is a continuous use of multiple measures repeated over time. 
Third, there is feedback to the learner to inprove performance. The goal of it 
all is to educate learners who self -assess, who become what Donald Schon calls 
"reflective practitioners." 

The second tradition or line of work is assessment as progran evaluation, that 
is, the evaluation of outcomes for a particular r^rricular segment. There are 
many earlier examples I could give, but let's start with the University of 
Minnesota general college evaluation studies done 45 years ago by Ruth Eckert and 
Bob Pace. They began with the question, **How effective is ujr general college 
curriculun in achieving the university's goals of general education?" Note that 
the unit of analysis is at the program level; this is not a of individual 

students^ There was an insistence in those Minnesota stu' es ipon evaluation 
based on clear goals. Multiple measures, many of them r^ated over time, were 
used. The intmt was strictly internal and formative, to generate infomtcition 
that could be fed back to the improvement or practice. Studies like this were 
don3 at the Un^'ersity of Chicago in the lO'Oc John Da¥^ '.ussell id others. 
(There was an in^nortant link, ther* ^th the N<m J. Cer^r^l Association, which 
had offices on the canifjus r>f ii^ u. • » Af ch*. 'age unt* . about 1*5 years ago.) 
At Michigan State, there were ' s that oon has referred to by Paul 

Dressel in the 'SOs and •60s. 

It is haiU to find large-scale, lone .:ital stucies of Uy\s <ype in more recent 
y»ars; there hasn't been university sponsorship for t'lem. People who regard 
their professional field as evaluation seem to have w/ed off campus to work in 
other fields where there are patrons and people who w/i^ t^.^ir work. They have 
been busy investigating head start programs, health-care delivery systems, the 
impact of Sesame Street on kindergartners, etc., but they have not been doing 
those kinds of studies on college canpuses. What we are le^t with is a spotty 
record of continuity, plus a handful of instrunents left over from earlier work, 
such as the IFI and the IGI. "Assessment as program evaluation,** then, today 
stands as an underdeveloped arena of work. 
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Ue should note here that the field of Institutional rei«arch came out of this 
tradition of work, before it moved to more adninistrative functions; more on this 
point later. Today, the premier example of this approach to assessment is 
certainly the University of Tennessee at Knoxville, led by Trudy Banta. At UT, 
they have pushed assessment doun into all the departments and programs of the 
university; it*s more akin to "program monitoring** than it is to the traditions 
of "program evaluation.** It is iterative, formative, and largely self- conducted 
by the individual units. Another example is the work of Dick Light, a professor 
of iCennedy School at Harvard and head this year of the American Evaluation 
Association. He*s doing a seminar at Harvard at President Bok*s request. One 
subject of investigation is the impact of Harvard's writing courses on students* 
ability to write a classic assessment program and evaluation question. 

A third tradition or line of work is academic research on aspects of student 
learning and growth over the course of the four years of college experience. 
These studies begin with questions like. What happens to students as people as a 
result of their college experience? How do they change in values, attitudes, 
motivation? How do they change cognitively? What is the inpact of the college 
or its programs on student development? 

As you all know, this is a long line of work, dating to the *20s and *30s. It 
was capped by Nevitt Sanford*s The American College (1962), and by Newcoirb and 
Feldto»n*s The Impact of College on Students (1969), which contained more than 
1,500 citations, and by Alexander Astin's Four Critical Years , which appeared 10 
years ago. This, too, is a line of work that has not been very active in rece«it 
years; the fruits of it, while of high intellectual interest, offer scant help to 
administrators or faculty who are looking for practical answers. This research 
often was driven by tqendat internal to the disciplines of psychology, sociology, 
and social psychology. Students were the available guinea pigs for its studies 
of peer-group influence, personality development, and so on. This wasn't 
research sponsored by institutions. It wasn't resea^'ch that sprang out of 
questions ?f legislators. It wasn't research that sprang out of questions that 
actual classroom teachers had. So that if you take the instrunents that many of 
these people used or developed the (FI, for exanple, or the old College 
Student Questionnaire what you get is information about student growth in 
*'peer independence," for example, answers to questions that nobody is aslcing and 
information that nobody knows how to use. 

In a way, the culmination today of research on student development is the value- 
added concept, which very properly shifts the focus of quality from program 
resources to progrin results, and which asks a good question of a coUege: What 
is your contribution to student learning? But the value-added concept is too 
often left flailing aromd when it comes to inplementation, because of the 
shortcomings of the prior research, weak instrunentation, and by its tendency to 
generate information that you don't know what to do with. I must add also, that 
the institutions that have pushed their way into value-added questions (e.g. 
Northeast Missouri State Universir/ and SUNY Plattsburgh) realize these limita- 
tions, ixjt have found ways to use the information anyway, if not psychometrically 
in the purest way, at least in very productive and generative ways. 

The fourth tradition is that of standardized testing. Standvdized testirig 
enjoyed a great vogue ir the 1920s as part of the efficiency movement in American 
education. Here at last we had a cheap, efficient, scientific way to gather 
informatfor. about student abilities and achievement so we could put cudents in 
tracks and help select them for college. Uhen we added the concept of norms we 
could compare students with one another, or even schools with one another, or 
states or nations. To give all of this a nice name, the testing industry and 
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State officials for at least the last two decades have called this kind of mass, 
statewide testing *ilar9e-scale assessment.** That usage has become so common, 
given the universality of this practice at the K•^2 level, th«c «ome p^le in 
higher education think the word "assessment** means statf.wide standb. dized 
testing. (It doesn*t, but that*s the connotation people hold). 

The outstanding institutional example of testing calculated from the start to 
tell a story to external publics is Northeast Missouri State University. It uses 
OiUy standard, norm- referenced tests tests that often have little relationship 
to their instructional systems but which have been used effectively to show the 
public that: a) Nvrtheait Missouri State will be accountable; b) its students are 
learning something, ai:d c) it is improving each year. 

The fifth tradition is that of the external senior examiner. This ii a British 
tradition, stilt widely used in England today. In the United States, it is most 
notably practiced at Swarthmore. The idea is that within a discipline, let*s say 
English, faculty from other comparable English departiients will be brought in to 
examine in a conprehensive way. In writing and orally, the senior English majors 
of the host institution. The technique provides a capstone experience for 
students plus feedback on their performance. It provides feedback to the host 
department and informs the institution about the department*s performance. The 
device employs nothing but expert peer Judgment. It forces the department to be 
clear with itself, with students, and before the examiners about what it is that 
it is trying to accomplish. It provides very little information to the general 
public that is useful in any accountability sense. It does illustrate a form of 
internal professional accountability captured by John Harris*s phrase, •'Somebody 
besides the cook should taste the pudding.** 

To test this kind of assessment further, there is a big experiment involving 18 
colleges and universities going right now, funded by FIPSE, and led by the 
Association of American Colleges. Uhat runs through these five assessment 
traditions? Uhat you see in every case is a focus on outcomes. Those outcomes 
are expressed in terms of a desired performance. The performance is usually 
criterion- referenced. Let me give an exanple that cuts across the five tradi- 
tions and conveys the spirit of it all. To a college that cared about student 
writing and held it as an important goal, it would be insufficient to do as we 
have done in the past when we merely added up the credit hours and said, '*Every 
student has to take two courses in English Comp and psfs them with at least a c.** 
The new perspective wouU; be to say, "Ue care about student writing. Students 
have to demonstrate to us that they actually can write at such and such a level 
before they are going to graduate.** It is that change in perspective that 
assessment brings about. Running through these traditions, too, there is an 
aspect of accountability to people outside the unit. Assfssmen* is formative; it 
is as complex and nuanced as that which we educate for. It relies upon expert 
judgment. It seeks improvement through the device of feedback. The goal in 
every case, whether it be assessment at the program level or with individual 
students, is to build habits of self -assessment. 

In this third sect^'on, I want to look at the evolving character of institutionjl 
research, and lay that character against today*s demands that we assess. 

The histories of both IR I assessment drihble back to the early years of this 
century, but I want to pick up their stories in the 1930s. That was a decade, 
like the present, marked by economic worries and by a corresponding attention to 
the quality of our educational systems. Quality concerns led many major univer- 
sities to set up faculty-dominated offices for the purpose of doing educational 
studies. A typical title was *'Bureau of Educational Research.** These offices 





existed through the *308 at nott of the Big 10 institutions, at the Uhiversity of 
Chicago, Syracuse, Antioch, San Francisco State, Florida, Stephens, Chicago City 
Junior College, Western Washington, Drake, and so on. 

In 1948, the University of Minnesota renamed its office •'Bureau of Institutional 
Research.** In succeeding decades, IR became increasingly, perhaps necessarily, 
an adjunct of management, concerned less and less with academic affairs than the 
issues of Institutional ackpinistration. IR entered into an era of space- 
utilization studies, student-flow analyses, load studies, cost studies, then 
market analysis, and so on, while, at least at the campus level, studies of 
eAJcational development all but dried up. (I am indebted to C. Robert Pace's 
1977 work. Measuring the Outcomes of College , for much of this information.) 

I do not conclude from this that IR somehow went astray, or that today's IR 
office is a pcorer cousin of its predecessors, or that you and I should somehow 
take \jp educational studies or be •Hjntrue" to our history. What I do observe is 
this: that ar. essential requisite for a well founded, contemporary progrfm of 
assessment requires something like those old bureaus, that is, an on-canpus locus 
of expertise for the planning, conduct, and use of assessments. Such an office 
reflecting what we've learned from successful campus programs would have a 
broad expertise, often offered on a consulting basis, a budget, close faculty 
ties, an educator (not a technician) as Its head, and reporting arrar^ements tied 
into academic and fiscal decision-making. You can see such models in the Office 
of Research and Evaluation at Alvemo College, in the IR office at Mimai-Dade, in 
the Learning Resource Center at The University of Tennessee-Khoxvi lie, and 
emergent in the new "second- wave" programs at SUNY-Plattsburgh, Clayton State in 
Georgia, James Madison University, and Keen State. Bob Diamond's work at 
Syracuse Center is also instructive. Uhen you look closely at those institutions 
that have become the leaders in institutional assessment, you see an office that 
looks a lot like what Ruth Eckert, Bob Pace, Bob Keller and later John Stecklein 
hid going at Minnesota many years ago. Uhat goes around c«^iies aroiixil 

My point, if I may suimarize, is this: a need, an opportunity, exists ft ---sess- 
ment that somehow will have to be met. Uhether it will be by you oi I 
cannot say, but surely IR should have a hand in the creation, or re-creation, of 
a function that should never have been let go. 

And so I come to a fourth point and the question, "nihat can IR brir^ to the 
practice of assessment?" Five things, let me suggest. 

The first tool to bring is a skeptical but open mind. Ue need to be skeptical 
because so much noise is being made on behalf of so little concrete knowledge. 
Uhatever we do know or don't know, our lack of an if)propriate knowledge base will 
not hold back demands that we get on with outcomes assessment, which leads me to 
the other side of thi.i point a hope that you'll not allow premature closure of 
the mind about assessii^nt. For me, pressures to assess are a train moving down 
the track at 80 nph. Ue are learning things, and what seemed ioprobable or 
impossible ip to now ma/ indeed be do-able. For exanple, years people have 
corplained about the ACT Ccflp and said there was no good instrtnent for measuring 
general education outcomes. Boom, ETS gets in gear, and in four months has just 
produced a new instrument meeting many of the objections and opening new vistas 
for institutional analysis. 

Another set of land mines is that, while there are five or more traditions of 
work going forward in the name of assessment, there are also schools and advocacy 
groups that claim Ihg important insight. You'll hear people talk about program 
evaluation or program review as though that were the real thing, others who 
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insist that assessment is reelly about standardized testing, or that value-added 
is the only real, appropriate analysis, or that criterion- referenced measures are 
the only permissable kind, and so on* Each statement brings an insight, but 
mostly about its maker, for the field offers a rich, expanding range of 
approaches that I hope youUl be open to in a non- ideological nay, lest premature 
closure of the mind occur and important options be denied your institution. 

My second hope for IR involvement is that you'll not lose "Hnnagement sensibil- 
ities** in taking a hard look at the assessment options before your institution. 
Uhy are ue doing X, not Y, in the name of assessment? what will it cost? Hou 
will it advance our mission? Uhat's the opportunity-cost raised b/ doing or not 
doing a certain step? Far from looking negatively on the course of Ik over the 
decades the shift from academic to menagement affairs -- Pm calling that 
shift an asset and asking that the decision criteria you apply to any IR you do 
be applied full bore to this new thing called as ses sme n t. I recall a speaker ask 
at the Montreal Forue, "If ue knew the answer to that question, what would we do 
with it?" That is a terrific question to hold in mind for assessment proposals. 
Someone might propose, for example, an ethnographic study of student culture. 
Sure, Pd like to see such a study; but whatever would adiinistrators do with its 
results? My suspicion is that you'll find a larger audience and real use for 
studies of program effects on student writing or of general education outcomes or 
of your teacher- education function. These are mundane matters, to be sure, but 
they are crucial parts of academic finctioning and key areas that need ieprove- 
ment. 

My third hope is that the planning skills you've brought to your offices and work 
will be brought to bear on your enco'jnters with assessment. I s«y this becauae 
assessment is not unlike any other major new undertaking a college might get 
into, such as a new building, academic program, or budgeting system. It raises 
issues that start with mission, it takes you back to purposes, it demand! 
clarification of goals, it requires involvement of stakeholders, it requires that 
choices be made, that funding follow, and that there be a plan to monitor 
results. I other words, we're talking planning, a point grasped from the start 
b/ the institutions with long-term success in assessment, but one that some of 
the next wave, amidst a lot of flailing around and false starts, have skipped. 
Don't skip It. 

One more exanple: to meet in full faith the SACS criterion for studies of 
effectiveness., a college would have to start five years in advance to collect and 
show good use for the requisite information, and do those processes of inquiry 
continuously, year in and out, to meet the spirit of the standard. Assessment 
doesn't work well (or even make much sense) done as a one-time, stand-alone 
function. You can't decide in May to have a significant outcomes st^dy ready to 
show the world by next fall. Assessment takes time, it implies choices and a 
longer-term commitment, which means that planning for assessment has to occur. 

Fourth, I hope IR will bring to assessment a needed sense of technical require- 
ments and of technical limits. I say that because I've seen incredible, terrible 
things done in the name of assessment, as though no one had ever heard of 
validity and reliability, or of using tests for the purposes they were intended. 
I've seer people draw preposterous, harmful conclusions from single data ele- 
ments. IR people, as managers with a research background, can tell campus 
Itf^iHers who would otherwise throw instruments around of the "Standards for 
.jcational and Psychological Testing" of the APA/AERA/NCME, or of the ETS 
"Standards for Quality and Fairness." Where program evaluation is the issue, IR 
people can disseminate the ''Standards for Evaluation of Educational Programs, 
Projects, and Materials" and keep in the discussion some sense that assessment 
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(like any technology) raises very real methodological and ethical problems. 
Simultaneously, as practical people, you may have a role, too, in keeping 
presuned experts at bay. The objection to any plan can (and will) be raised that 
it fs imperfect, that there's a better way to be invented soon, that invo'es 
grounded theory and will use LISREL analysis, etc., none of which can be done for 
another three years or at a cost of less than $300,000. If you wait for the 
perfect approach, yoj*ll never do anything. The need {s to start a process of 
inquiry that can inprove over time and generate along the way information good 
enough not for a journal but for the better deployment of instructional re- 
sources. 

Fifth, and last, beware of the trap of seeing state or accreditation demands to 
assess as simply a new reporting requirement. To view them simply as a mandate 
to docimant student learning will backfire on you, especially If you disconnect 
that assessment mechanism from any internal process for Inprovement. Uhat's at 
stake is not some new requirement to send nunbers to the state capital, but what 
those nunbers mean. People will be asking, **How good is the level of achievement 
those nunbers document, &d why aren't they Improving this year over last?** What 
you do in the name of assessment has to be linked to Internal inprovement 
agendas. 

Let me conclude these remarks back where I started. I think that In the next 
three years we're going to see assessment become a permanent part of our land- 
scape, of the way we do business in higher education. The jury Is very much out, 
however, as to what it will mean. At its meanest level, it might become little 
more than testing and a reporting requirement, tokens offered in the name of 
accountability. At its best, assessment can become a rich set of powerful tools 
that push us and our students to higher levels of performance. Your wise 
participation in our collective engagement with this issue called assessment can 
make a significant difference in that outcome. I urge you to It. 
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AND FLNALLY . . . THE AIRTONES 




Picture courtesy of Everett Beeson PhotO0ra|iiy« Overland Park, KS« 

AccoHpenied at the pfano by '■Peggy Sue** a.k.a Linda Nannering the Airtones 
entertained thenseivet and all others attending the Awards Luncheon in the Count 
Basie Ballroom of the Vista International Hotel on Wednesday, May 6, 1987. They 
are, from left to right: Don Norris, Vice President of the M i H GroMp, Herndon, 
VA; Greg Lozier, Executive Director of Planning and Analysis Pennsylvania State 
university; Bill Lasher, Associate Vice President for Budget and Institutional 
Analysis, University of Texas-Austin, and Richard Harpel, Assistant to the 
Chancellor and Director of Planning at the University of Colorado- Boulder. 

Their medley went more or less like this: 

Best Fact Book 
(to the tiDe of ''Book of Love") 

I wonder, wonder, who wrote the best fact book? 

Tell me, tell me, tell, oh who wrote the best fact book? 
I've got to know the answer, will you Kelp me look? 

I love my data, baby you know i do, 

F*<t I've got to find the best fact book, 
Aitd make mine better, too. 
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Chapter ont's About students, you love them with all your heart. 
Chapter two's about faculty, they'll never, never, never, 

never depart. 
In chapter three ramnber the inportance of finance. 
In chapter four you break ground to expand your physical plant. 

Data, data, data, I love you, yes I do; 

And P II put you in my new fact book so others can love you, tool 
I wonder, wonder, who wrote the best fact book? 



Policy analysis, information anarchy. 
Data base technology, enrollment maragement. 
Market segmentation, resource reallocation. 
Cohort analysis, and computer graphics. 

User friendly software, decision systems. 
Academic governance, too. 
Putiin* on a ruse. 

Forecasting and modeling, external reviews 

and self*studies are great, too. 
Puttin* on a ruse. 

Environmental scanning and planning. 

Value added education, outcome&, accreditation; 

Information specialists, BITNET, PCs, and data base 

are what you get. 
Putt in' on a ruse. 



Now that the Forum's over, 

McLaughlin lets out a big sig^, 

Nelodie Christal's anxious. 

Deb Teeter cries, "Kiss it goodbyel" 

Many a paper's been given. 

The sessions all were great. 

Now we invite you to join us. 

In Phoenix in eighty-eight! 



Puttin* on a Ruse 
(to the tune of "Puttin' on the Ritz«) 



Now that the Forum's Over 
(to the tune of "After the Ball") 
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AIR PUBLICATIONS 



Regular AIR publications include: 

Research in Higher Education 

New Directions for Institutional Research 

AIR Professional File 

Some of the papers presented at each annual Forum are published in Research in 
Higher Education or the AIR Professional File . 

Suggestions and offers of assistance may be sent to the chairperson of the AIR 
Publications Board or the AIR Executive Office. 



AIR Publications Board 
Penny A. Wallhaus, Chair 
Office of Analytical Studies 
Northwestern University 
633 Clark Street 
Evanston, IL 60201 
Telephone: (512) 491-4335 



AIR Executive Office 
Jean C. Chulak, Administrative Director 
314 Stone Building 
Florida State University 
Tallahassee, FL 32306*3038 
Telephone: (904) 644-4470 



ERLC 



